-- Logs begin at Tue 2022-07-26 09:39:41 UTC, end at Tue 2022-07-26 10:41:03 UTC. -- Jul 26 10:11:04.837212 dv-osbrick-850937-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 10:11:04.848305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 10:11:04 2022] *** Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: nodename: dv-osbrick-850937-2-iscsi Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: machine: x86_64 Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: clock source: unix Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: pcre jit disabled Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: detected number of CPU cores: 4 Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: current working directory: / Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: detected binary path: /usr/bin/uwsgi-core Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: your processes number limit is 47680 Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: your memory page size is 4096 bytes Jul 26 10:11:04.850205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: detected max file descriptor number: 2048 Jul 26 10:11:04.851474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: lock engine: pthread robust mutexes Jul 26 10:11:04.851474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: thunder lock: enabled Jul 26 10:11:04.851474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 10:11:04.851474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 10:11:04.891056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: Python main interpreter initialized at 0x56035e5f69c0 Jul 26 10:11:04.891056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: python threads support enabled Jul 26 10:11:04.891056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: your server socket listen backlog is limited to 100 connections Jul 26 10:11:04.891056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: your mercy for graceful operations on workers is 90 seconds Jul 26 10:11:04.891569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 10:11:04.891569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: *** Operational MODE: preforking *** Jul 26 10:11:04.891768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: *** uWSGI is running in multiple interpreter mode *** Jul 26 10:11:04.891768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: spawned uWSGI master process (pid: 80299) Jul 26 10:11:04.892044 dv-osbrick-850937-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 26 10:11:04.896434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: spawned uWSGI worker 1 (pid: 80311, cores: 1) Jul 26 10:11:04.896434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: spawned uWSGI worker 2 (pid: 80312, cores: 1) Jul 26 10:11:04.896434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80299]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 10:11:10.588093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:11:10.588093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: from cryptography.utils import int_from_bytes Jul 26 10:11:10.589340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:11:10.589340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: from cryptography.utils import int_from_bytes Jul 26 10:11:10.590344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:11:10.590344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: from cryptography.utils import int_from_bytes Jul 26 10:11:10.591116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 10:11:10.591116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: from cryptography.utils import int_from_bytes Jul 26 10:11:10.640573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 10:11:10.640816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 10:11:10.641024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] command line args: [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 10:11:10.641241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 10:11:10.641403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ================================================================================ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 10:11:10.641663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] admin_token = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.641910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config_dir = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.642097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.642248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 10:11:10.642399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] config_source = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.642529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 10:11:10.642650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] debug = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.642784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] command line args: [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 10:11:10.642919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.644769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 10:11:10.644769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ================================================================================ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 10:11:10.645050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] admin_token = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] config_dir = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] config_source = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.645989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] debug = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_config_append = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_dir = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.646972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647543 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_config_append = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.647902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_dir = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.648921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.649972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.650799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] publish_errors = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.651907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.652122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.652241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.652354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] publish_errors = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.652481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] standard_threads = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.652609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.652758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_journal = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_json = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.653983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.654166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_stderr = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.654340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] standard_threads = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.654479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] use_syslog = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.654607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.654739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.654886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.655123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.655256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.655395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.655519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] use_journal = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.655519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] use_json = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.655750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.655880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] use_stderr = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.656011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.656141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] use_syslog = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.656269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.656401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 10:11:10.656552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.656685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.656824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.656981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.657887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.658935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.659066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.659197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.659404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.659550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.659694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.659941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.660909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.661974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.662878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.663939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.664866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.665933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666543 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.666934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.667993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.668132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.668267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.668410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.668539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.668729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.668939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.669120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.669287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.669457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.669630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.669811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.669978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.670150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.670319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.670489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.670714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.670865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.671000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.671173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.671310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.671497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.671681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.671873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.672098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.672271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.672443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.672581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.672767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.673990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.674194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.674328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.674500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.674632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.674750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.674962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.675963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.676932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.677879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.678911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.679995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.680126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.680254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.680383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.680510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.680652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.680964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.681994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.682953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.683974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.684988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.external = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.685857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.external = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.password = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] auth.token = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.686702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.687457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.687611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.687747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.687880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.password = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] auth.token = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.688977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.689989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.690246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.690375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.690498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.690625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.690754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.690754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.691904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.692924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.693987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.694946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.695919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.696989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.697223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.697223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.697600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.697600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.697852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.697985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.698876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.699935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.700923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.701987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.702115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.702242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.702371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.703996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.704965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.705976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.706982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.707884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.708810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.709949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.710934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.711842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.712083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.712216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.712359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.712504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.712642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.712777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.713888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.714195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.714369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.714517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.714646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.714775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.714903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.715910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.716945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.717907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.718970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.719885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.720971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.721878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.722960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.723992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] role.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.724901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] role.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.725996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.726879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.727801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.728927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.729873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.730008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.730143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.730540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.730689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.730825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.730958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.731897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.732863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.733943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.734989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.735908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.736815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.737988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.738907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.739965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.740899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.741913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.742968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.743100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.743230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 10:11:10.743361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.743361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.743361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 10:11:10.743361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 10:11:10.758309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.758567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.758755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.759103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.759384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.759523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.768678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.769126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.800602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.800932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.801183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.801419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.859084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.862527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.913828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.914177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.914323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.914526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.985669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.985944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.986923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.987054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.987172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:10.987172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.012292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.012554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.012687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.012830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.013932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.014126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.014264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.014499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.025996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.026593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.039724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.039953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.040864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.041064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.041166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.041388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.041652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.041930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 10:11:11.059471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.059765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:11:11.059941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.060091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.060231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:11:11.060369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:11:11.060506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.060704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.060873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.061005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.061144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 10:11:11.061238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.061474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.061806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.062676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.062998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.071775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.072061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.072334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.072623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.073310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.073701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.074025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.074363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.079709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.081625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.084650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.084970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.085417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.085574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.085809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.086067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.086379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.086791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.087069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.087221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.087362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.087603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.087752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.088001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.088347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.088690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.089041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.089366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.089708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.090041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.090379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.090701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.111589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.113036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.113321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.114917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.116505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.116885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.117977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.118259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.118542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.121805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.122196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.122558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.125809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.126102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.130148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.130333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.130482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.130624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.130832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.131120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.131397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.131671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.131950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.132226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.134527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.134814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.135098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.135376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.135657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.135943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.136203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.136474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.148316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.148610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.152597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.152770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.153027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.155809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.156115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.156997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.160113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.160407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.160555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.163780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.164811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.167105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.167408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.167694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.167977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.168154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.168296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.168538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.171739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.172042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.172331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.172618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.172919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.173207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.185264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.185571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.185818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.186079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.189807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.190106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.190371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.190634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.193648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.195212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.195490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.197520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.198354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.198637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.198938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.199078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.199210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.199345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.199489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.202121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.202457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.202760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.203037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.203329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.211118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.211407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.211690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.211974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.212257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.212530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.212805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.214669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.214961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.215233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.215507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.215786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.216060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.216324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.228574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.231886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.232325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.235448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.235913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.238177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.238890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.239706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.239999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.240280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.241590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.243087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.243384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.243691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.246867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.248500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.250887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.252077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.252365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.252508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.252649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.252958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.255439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.255722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.256004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.256282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.261075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.261372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.261659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.264294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.264587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.265058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.268741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.269055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.269339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.269615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.269887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.270173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.270451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.270733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.271116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.271395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.271680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.271828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 10:11:11.271970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.272128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.272343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.272484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.272620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.272768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.272947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.273122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.273394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.273664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.274040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.274324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.274603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.274876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.275135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.275389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 10:11:11.307307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56035e5f69c0 pid: 80311 (default app) Jul 26 10:11:11.309508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56035e5f69c0 pid: 80312 (default app) Jul 26 10:11:11.311071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f287ace-3fec-49d1-864b-bb1796dba08b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:11.311360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f287ace-3fec-49d1-864b-bb1796dba08b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:11.311639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f287ace-3fec-49d1-864b-bb1796dba08b None None] PATH_INFO: `/v3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:11.316333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Jul 26 10:11:11 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:19.260464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:19.261070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:19.261070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:19.265464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:19.271729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:19.272257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:19.272353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:19.343733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: INFO dbcounter [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] Registered counter for database keystone Jul 26 10:11:19.366170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG oslo_db.sqlalchemy.engines [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 10:11:19.373207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writer thread running {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 10:11:19.564407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG passlib.handlers.bcrypt [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80311) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 10:11:19.564749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG passlib.handlers.bcrypt [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80311) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 10:11:19.627378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:19.629086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:19.798816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 528 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 10:11:19.952216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:20.023041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: INFO dbcounter [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] Registered counter for database keystone Jul 26 10:11:20.042670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG oslo_db.sqlalchemy.engines [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 10:11:20.049600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writer thread running {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 10:11:20.171044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fb494-6d13-4788-b36c-b70fa6369eed None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:20.176802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:20.177506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:20.177909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:20.178224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:20.189336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:20.250593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING keystone.common.rbac_enforcer.enforcer [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 10:11:20.251016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576525b6-1d7f-4686-9f7a-071e188853f6 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:20.266084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jul 26 10:11:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:11:20.274098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:20.294148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466d47c-f51a-4c31-8b7e-7510c202481e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:20.299016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:20.300192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:20.300475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:20.300751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] PATH_INFO: `/v3/projects/efd8d0a5798b4c52a018435ee59fbf54` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:20.302350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] RBAC: Authorizing `identity:get_project(project_id=efd8d0a5798b4c52a018435ee59fbf54)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:20.366432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 10:11:20.366907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee40c1-4ee8-4544-9500-136224673695 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:20.373104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Jul 26 10:11:20 2022] GET /identity/v3/projects/efd8d0a5798b4c52a018435ee59fbf54 => generated 344 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:22.481919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd394-0a2a-4c96-899b-cd84a0015aa9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:22.482695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd394-0a2a-4c96-899b-cd84a0015aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:22.482695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdd394-0a2a-4c96-899b-cd84a0015aa9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:22.486608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:22.492320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:22.492825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:22.492987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:22.523721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:22.525332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:22.534143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 10:11:22.556527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdd394-0a2a-4c96-899b-cd84a0015aa9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:22.580216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdd394-0a2a-4c96-899b-cd84a0015aa9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:22.584879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936647f-076e-46ea-8cd2-b02446fbace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:22.585586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936647f-076e-46ea-8cd2-b02446fbace0 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:22.585913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936647f-076e-46ea-8cd2-b02446fbace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:22.586234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936647f-076e-46ea-8cd2-b02446fbace0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:22.595262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936647f-076e-46ea-8cd2-b02446fbace0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:22.597095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936647f-076e-46ea-8cd2-b02446fbace0 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:22.607385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Jul 26 10:11:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:11:22.613393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:22.625351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fde082-c6f8-4297-9b79-f2326ec1ec84 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:22.629998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0b754-54b1-4a57-947b-5d1902ea5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:22.630671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b754-54b1-4a57-947b-5d1902ea5720 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:22.630953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b754-54b1-4a57-947b-5d1902ea5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:22.631232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0b754-54b1-4a57-947b-5d1902ea5720 admin admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:22.632713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0b754-54b1-4a57-947b-5d1902ea5720 admin admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:22.634676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0b754-54b1-4a57-947b-5d1902ea5720 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:22.636454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Jul 26 10:11:22 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:24.831706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201730b-21eb-4e17-8df8-eff5d3209e73 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:24.832243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201730b-21eb-4e17-8df8-eff5d3209e73 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:24.832243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201730b-21eb-4e17-8df8-eff5d3209e73 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:24.834542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:24.840078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc21dcf-39f5-4230-9e7b-ebc783a3414d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:24.840643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc21dcf-39f5-4230-9e7b-ebc783a3414d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:24.840643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc21dcf-39f5-4230-9e7b-ebc783a3414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:24.861240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8cc21dcf-39f5-4230-9e7b-ebc783a3414d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:24.862486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8cc21dcf-39f5-4230-9e7b-ebc783a3414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:24.990532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:25.015784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201730b-21eb-4e17-8df8-eff5d3209e73 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.158075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d16f6-dc43-4c0e-91bc-8f2058be4ed9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.158403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d16f6-dc43-4c0e-91bc-8f2058be4ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.158726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d16f6-dc43-4c0e-91bc-8f2058be4ed9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.160153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 7/12] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:25.168302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.168705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.169018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.174742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201730b-21eb-4e17-8df8-eff5d3209e73 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:25.189619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:25.190853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:25.216720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:25.226370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:25.226942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.227226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.227503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.242872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:25.253676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:25.254685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:25.255515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 6/13] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:25.261530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.293961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 8/14] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:25.319608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:25.320373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.421184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be911dc8-f631-4328-9c24-3d6d43c37b80 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:25.463407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:25.464043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.464320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.464589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.465372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:25.465670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:25.466740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09abdd1-6fe8-440c-a788-4a317dee478c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:25.467863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:25.482713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:25.488551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.521703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:25.522337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.522620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.522886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.546729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:25.609952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:25.617273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b653-3686-4991-ab2e-7c582952f044 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:25.635415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:25.638262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:25.677386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:25.677962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.678341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.678612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.680419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:25.681956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:25.683809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 8/16] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:25.690155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.817442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 9/17] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:11:25.818724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fb00d-8761-4df1-8825-6bedbdd6554c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:25.825262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.857334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be743-509f-469d-9612-575e7a437436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:25.858158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be743-509f-469d-9612-575e7a437436 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:25.858375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be743-509f-469d-9612-575e7a437436 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:25.858559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be743-509f-469d-9612-575e7a437436 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:25.859864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07be743-509f-469d-9612-575e7a437436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:25.861358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07be743-509f-469d-9612-575e7a437436 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:25.863334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:25.868811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be743-509f-469d-9612-575e7a437436 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:25.904177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:25.908181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:25.987509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6598947-37d4-46d5-b862-b0a219e16729 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:26.004368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be743-509f-469d-9612-575e7a437436 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:26.036011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:26.037074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:26.037532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:26.037940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:26.050884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:26.051859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:26.052305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:26.052749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:26.054159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.domain.id=default, user.id=3f82692456794f98aaedf11a512d650d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:26.054653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:26.057240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:26.072561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/role_assignments?user.id=3f82692456794f98aaedf11a512d650d&scope.domain.id=default&role.id=2b446efbd008435f977d0068496eb403 => generated 233 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:26.172277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:26.174110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3e2439fa-91b6-4060-a24c-c54ed06b0acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:11:26.195352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:26.196275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:26.197591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:11:26.197591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:11:26.197591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:11:26.197591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:26.197591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:26.203378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:26.315120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:26.322538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a0393-0df6-4c48-94a5-fbaf87995110 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:26.360063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:26.360727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:26.361042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:26.361321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:26.362032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:26.362349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:26.363755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f0648-c521-4df3-9c6d-ab415c42214b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:26.386591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:29.493670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568257-82b8-4ff0-bab9-7a5dd0c2b741 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:29.494483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568257-82b8-4ff0-bab9-7a5dd0c2b741 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:29.494622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8568257-82b8-4ff0-bab9-7a5dd0c2b741 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:29.497372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:29.506853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:29.507597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:29.507767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:29.546872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG passlib.handlers.bcrypt [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80312) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 10:11:29.547555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG passlib.handlers.bcrypt [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80312) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 10:11:29.604632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:29.607690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ab040010-25e2-470c-8bfe-5a0e58a4c262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:29.761644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:29.835809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568257-82b8-4ff0-bab9-7a5dd0c2b741 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:29.854410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9a99-9032-4951-85ae-294c319784b9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:29.855030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9a99-9032-4951-85ae-294c319784b9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:29.855766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b9a99-9032-4951-85ae-294c319784b9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:29.857397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:29.876354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363e18e-cc1b-4436-91d6-5060e63e4701 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:29.877001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363e18e-cc1b-4436-91d6-5060e63e4701 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:29.877473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363e18e-cc1b-4436-91d6-5060e63e4701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:29.908829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e363e18e-cc1b-4436-91d6-5060e63e4701 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:29.916148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e363e18e-cc1b-4436-91d6-5060e63e4701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:30.106548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:30.107921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc7834-6569-423e-abe7-6a5033f6e670 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.108245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc7834-6569-423e-abe7-6a5033f6e670 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.108518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc7834-6569-423e-abe7-6a5033f6e670 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.109875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 15/26] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:30.111293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8568257-82b8-4ff0-bab9-7a5dd0c2b741 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:30.115480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.115765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.116046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.120735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:30.227393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:30.228525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.229043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.229523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.272758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:30.274318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:30.280174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:30.281427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:11:30.308006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:30.308945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:30.309758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:11:30.309758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:11:30.309758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:11:30.309758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:30.309758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 12/27] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 474 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:11:30.315702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:30.315876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:30.408753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 16/28] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:30.410017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:30.475527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be375c97-dba5-4d19-803d-b68e08255e01 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:30.514931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8db4d-eb2d-48ac-aca4-1bad98eee784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:30.516296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8db4d-eb2d-48ac-aca4-1bad98eee784 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.516754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8db4d-eb2d-48ac-aca4-1bad98eee784 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.517311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8db4d-eb2d-48ac-aca4-1bad98eee784 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.530608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8db4d-eb2d-48ac-aca4-1bad98eee784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:30.530793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d94944-c7b8-4fce-a321-c8963754c711 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ada8db4d-eb2d-48ac-aca4-1bad98eee784 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:30.538285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:30.539207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:30.539983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:30.542444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 13/29] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:30.543980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aece0f-b681-4d44-9f8c-f2441312d5c0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.544492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aece0f-b681-4d44-9f8c-f2441312d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.545036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aece0f-b681-4d44-9f8c-f2441312d5c0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.547149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 14/30] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:30.548124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aece0f-b681-4d44-9f8c-f2441312d5c0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:30.576313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:30.577033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.577324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.577594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.578304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:30.578609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:30.578934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:30.580067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:30.603300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 17/31] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:30.604644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:30.621742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:30.706813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aece0f-b681-4d44-9f8c-f2441312d5c0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:30.768284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57706b61-b4c5-4818-8081-8c5352f7e6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:30.769303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706b61-b4c5-4818-8081-8c5352f7e6a5 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.769778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706b61-b4c5-4818-8081-8c5352f7e6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.770245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57706b61-b4c5-4818-8081-8c5352f7e6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.771470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57706b61-b4c5-4818-8081-8c5352f7e6a5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:30.773702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57706b61-b4c5-4818-8081-8c5352f7e6a5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:30.794415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8ba14-cd37-4262-ad19-77e93bfe6c3a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:30.854430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:30.855666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.856191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.856651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.858002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:30.859125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:30.861913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9722ec-e03b-4a27-904f-e4170d1b002c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:30.885230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:30.887592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.888063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.888500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.918967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:30.921524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:30.967395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 15/33] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 10:11:30 2022] POST /identity/v3/roles => generated 225 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:30.969482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce238d-7ad5-4da3-b530-4e7c6aa5428f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:30.969832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce238d-7ad5-4da3-b530-4e7c6aa5428f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:30.970118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce238d-7ad5-4da3-b530-4e7c6aa5428f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:30.971406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 16/34] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:30.972161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce238d-7ad5-4da3-b530-4e7c6aa5428f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.013356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:31.020349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 19/35] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:31.021093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.116939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:31.169578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce238d-7ad5-4da3-b530-4e7c6aa5428f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:31.172335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d2d4-47ab-4509-b16a-ed4e36d9ad84 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:31.214485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:31.215433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.215877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.216311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.217056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:31.218832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:31.233079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a1607-e82f-465d-89cf-d0a4e4ce0ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:31.234675 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1607-e82f-465d-89cf-d0a4e4ce0ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.234675 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1607-e82f-465d-89cf-d0a4e4ce0ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.234852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a1607-e82f-465d-89cf-d0a4e4ce0ca7 None admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.236421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a1607-e82f-465d-89cf-d0a4e4ce0ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:31.237966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a1607-e82f-465d-89cf-d0a4e4ce0ca7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:31.239848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 20/36] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:31 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:31.242446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118db1a-8a7c-4464-8431-d140da121e3b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.242702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118db1a-8a7c-4464-8431-d140da121e3b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.242989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118db1a-8a7c-4464-8431-d140da121e3b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.244390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 21/37] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:31.250253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.250544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.250827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.255754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 17/38] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:11:30 2022] POST /identity/v3/projects => generated 301 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:31.258172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.271019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:31.272384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:31.354307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:31.365536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 22/39] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:31.366818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.427358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f1d5-e04f-4253-8b0c-79e6fa6b0520 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:31.474115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:31.491372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e574-c8be-4f8c-bbf7-316c886a25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:31.493095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e574-c8be-4f8c-bbf7-316c886a25d9 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.494924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e574-c8be-4f8c-bbf7-316c886a25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.495387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e574-c8be-4f8c-bbf7-316c886a25d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.496618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e574-c8be-4f8c-bbf7-316c886a25d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:31.499724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e574-c8be-4f8c-bbf7-316c886a25d9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:31.513132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409899c-fceb-4867-8007-23d8e7f958fe None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:31.518658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 18/40] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 10:11:31 2022] POST /identity/v3/roles => generated 219 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:31.528934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.528934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.528934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.547652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:31.550168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:31.569349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:31.570347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.570781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.571200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.573155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:31.575552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:31.578458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 23/41] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:31.579621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.664223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 19/42] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:31.664780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.685413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:31.761242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ececa-53a3-4f77-b82f-edfac1e0a7c8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:31.800073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:31.800711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.801026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.801305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.802044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:31.803440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:31.825578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcfa21-516d-4f63-b9d2-6be3d23b542e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:31.851662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:31.876193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:31.876916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:31.877203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:31.877492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] PATH_INFO: `/v3/domains/default/users/3f82692456794f98aaedf11a512d650d/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:31.879536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3f82692456794f98aaedf11a512d650d, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:31.881038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:31.897981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Jul 26 10:11:31 2022] PUT /identity/v3/domains/default/users/3f82692456794f98aaedf11a512d650d/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:11:31.898829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:31.929608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 24/44] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 10:11:31 2022] POST /identity/v3/roles => generated 223 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:32.073056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdded38-bf08-4f3b-a99b-c925d23380dd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:32.131409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb74fc2-8f88-45e0-82e0-746886d91110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:32.132100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74fc2-8f88-45e0-82e0-746886d91110 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:32.132383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74fc2-8f88-45e0-82e0-746886d91110 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:32.132699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb74fc2-8f88-45e0-82e0-746886d91110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:32.134085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb74fc2-8f88-45e0-82e0-746886d91110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:32.135621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb74fc2-8f88-45e0-82e0-746886d91110 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:32.137497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 21/45] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:32.144300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:32.277539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19012-373d-4df7-ae04-37ee2970eb32 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:32.306430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:32.325373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8b2f4-f901-4eeb-b68b-bc6a98b60b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:32.325950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8b2f4-f901-4eeb-b68b-bc6a98b60b2f None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:32.326236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8b2f4-f901-4eeb-b68b-bc6a98b60b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:32.326514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8b2f4-f901-4eeb-b68b-bc6a98b60b2f None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:32.327784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8b2f4-f901-4eeb-b68b-bc6a98b60b2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:32.329456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8b2f4-f901-4eeb-b68b-bc6a98b60b2f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:32.367460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 25/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:11:32 2022] POST /identity/v3/projects => generated 312 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:33.975655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e244df-1f51-47c8-8d1d-2795a4d1e04f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:33.976168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e244df-1f51-47c8-8d1d-2795a4d1e04f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:33.976306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e244df-1f51-47c8-8d1d-2795a4d1e04f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:33.977804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 22/47] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:33.984881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:33.985416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:33.985540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.008319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:34.010613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:34.090668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 26/48] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:34.114680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e244df-1f51-47c8-8d1d-2795a4d1e04f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.168193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:34.229442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e244df-1f51-47c8-8d1d-2795a4d1e04f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.275114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:34.276220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.276728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.277272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.296951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:34.306865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:34.307768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:34.308541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:34.309171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 23/49] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:34.315107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.425871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba784a4-3a24-4f7e-a3e4-e3b624e609ba None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.434228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:34.465362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:34.466009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.466292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.466570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.467312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:34.468230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:34.469698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462947-dce2-4693-bea0-9506b2acdb09 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:34.478941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 27/50] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:34.485689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.492175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c7ed-857b-47a8-8055-4aa7f9bd5996 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.492438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c7ed-857b-47a8-8055-4aa7f9bd5996 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.492724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0003c7ed-857b-47a8-8055-4aa7f9bd5996 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.494121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 28/51] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:34.499586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.499880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.500160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.519119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:34.520380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:34.593924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 29/52] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:34.618453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.622896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87bb366-b8a4-4043-af88-7dcd5bb3d31f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.631109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:34.663274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:34.664103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.664388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.664662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.666062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:34.667613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:34.669420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 24/53] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:34 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:34.675245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.766303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:34.772356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645aee-eb1c-4905-8768-95ea1a4eeaf0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.807892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ba660-3496-4b5e-a8f3-22a4a83148e3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.820268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:34.820997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.821285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.821563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.822760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:34.824256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:34.825956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 30/54] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:34.834461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.854656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:34.855572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.855860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.856135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.857393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:34.858880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:34.860556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 25/55] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:34.866498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:34.923148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:34.952388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0000f9-eb7f-4f9b-96ea-d4966bac0f9d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.992171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448172c-9993-41bf-a668-16da9e5a1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:34.992883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448172c-9993-41bf-a668-16da9e5a1361 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:34.993114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448172c-9993-41bf-a668-16da9e5a1361 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:34.993205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25315b10-4aad-4674-84ec-7e71351ff213 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:34.993557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448172c-9993-41bf-a668-16da9e5a1361 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:34.994071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448172c-9993-41bf-a668-16da9e5a1361 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:34.995532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448172c-9993-41bf-a668-16da9e5a1361 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:35.024209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 31/56] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jul 26 10:11:34 2022] POST /identity/v3/projects => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:11:35.031718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:35.032385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:35.032672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:35.032990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:35.033825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.domain.id=default, user.id=3f82692456794f98aaedf11a512d650d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:35.034141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:35.035674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13951ab2-c39a-4cc2-b067-64c9dca310f9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:35.044314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 26/57] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Jul 26 10:11:34 2022] GET /identity/v3/role_assignments?user.id=3f82692456794f98aaedf11a512d650d&scope.domain.id=default&role.id=2b446efbd008435f977d0068496eb403 => generated 530 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:37.133422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7137199-ba54-4a13-b904-4cffe722d8f0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:37.133990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7137199-ba54-4a13-b904-4cffe722d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:37.133990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7137199-ba54-4a13-b904-4cffe722d8f0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:37.135350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 32/58] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:37.141583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:37.142195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:37.142195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:37.161378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:37.162617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:37.240466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 27/59] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:37.264890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7137199-ba54-4a13-b904-4cffe722d8f0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:37.285984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:37.373060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7137199-ba54-4a13-b904-4cffe722d8f0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:37.409185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd2025-1c87-4da3-b8d0-51f983c24560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:37.409840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd2025-1c87-4da3-b8d0-51f983c24560 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:37.410128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd2025-1c87-4da3-b8d0-51f983c24560 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:37.410409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd2025-1c87-4da3-b8d0-51f983c24560 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:37.411597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd2025-1c87-4da3-b8d0-51f983c24560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:37.413082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd2025-1c87-4da3-b8d0-51f983c24560 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:37.414924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 33/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:37.421439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:37.457516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:37.552758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86075cdf-ba7e-4fe3-9cf9-46cbf07ffe06 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:37.603732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfa1a4-521d-4b5b-b81e-d77bdfd58d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:37.604356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa1a4-521d-4b5b-b81e-d77bdfd58d5d None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:37.604637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa1a4-521d-4b5b-b81e-d77bdfd58d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:37.604952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfa1a4-521d-4b5b-b81e-d77bdfd58d5d None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:37.605914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfa1a4-521d-4b5b-b81e-d77bdfd58d5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:37.607382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfa1a4-521d-4b5b-b81e-d77bdfd58d5d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:37.635890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 28/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:11:37 2022] POST /identity/v3/users => generated 275 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:40.972689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bec630-4b2c-420e-8b7c-321107f28f10 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:40.973262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bec630-4b2c-420e-8b7c-321107f28f10 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:40.973262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bec630-4b2c-420e-8b7c-321107f28f10 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:40.974642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 34/62] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:40.980068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:40.980807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:40.980915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.010977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:41.012202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:41.079056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25dc27-7cf5-419e-b316-4a54d66268e0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.079342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25dc27-7cf5-419e-b316-4a54d66268e0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.079865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25dc27-7cf5-419e-b316-4a54d66268e0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.081291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 35/63] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:41.091740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba3ef-2192-4b89-abc7-69bcbee6388d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.092354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba3ef-2192-4b89-abc7-69bcbee6388d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.093296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba3ef-2192-4b89-abc7-69bcbee6388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.110746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 29/64] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:41.137982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d1dba3ef-2192-4b89-abc7-69bcbee6388d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:41.141516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d1dba3ef-2192-4b89-abc7-69bcbee6388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:41.154194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:41.215969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:41.271379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 36/65] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:41.273351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43e43-2485-4d8a-8f75-ed4c7fa3c985 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.274061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43e43-2485-4d8a-8f75-ed4c7fa3c985 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.274793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43e43-2485-4d8a-8f75-ed4c7fa3c985 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.276812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 37/66] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:41.284019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.284735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.286048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.307207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:41.308742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:41.328118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:41.378352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99c737-94d6-4b17-987f-799aea8b1655 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:41.425997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:41.427100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.427595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.428081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.435880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 38/67] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:41.437681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:41.450447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:41.456463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:41.457421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:41.458211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:41.467592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 30/68] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:11:41.473607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:41.578448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7ce00-9764-4e6b-a3db-1f58ffea609f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:41.584149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:41.611679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1ca0-2bdb-4faa-aefc-83f2d2aacbaf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:41.620600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:41.621913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.622678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.624033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.640341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:41.646801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:41.647819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:41.648678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:41.651683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 39/69] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:41.652828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:41.659386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:41.660028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.660310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.660667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.661461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:41.661767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:41.663199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3862f-5697-4c1e-9d15-0fdc2f9ea76e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:41.663483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:41.678331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 31/70] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:41.684223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542a05-766e-4e10-b69d-1c262c61c81f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.684525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542a05-766e-4e10-b69d-1c262c61c81f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.684805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542a05-766e-4e10-b69d-1c262c61c81f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.686752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 32/71] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:41.689696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a542a05-766e-4e10-b69d-1c262c61c81f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:41.784495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c157de0-7de6-49b6-b91d-5f342d6f5f04 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:41.824120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:41.824926 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.825216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.825500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.832740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a542a05-766e-4e10-b69d-1c262c61c81f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:41.848324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:41.859337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:41.861572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 40/72] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:41.863491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:41.881369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:41.882313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.882594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.882869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.883599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:41.883912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:41.885350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5acb05-9c08-4dab-9bcf-9f7b429f3759 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:41.895024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 33/73] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:41.897535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3352-4664-4090-8952-275b6fb7805a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:41.897828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3352-4664-4090-8952-275b6fb7805a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:41.898105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c3352-4664-4090-8952-275b6fb7805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:41.911057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:41.917623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5d4c3352-4664-4090-8952-275b6fb7805a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:41.918881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5d4c3352-4664-4090-8952-275b6fb7805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:41.938046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:41.976866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe5400-dd83-496e-a8db-ef7ac9170b3d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.000181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 34/74] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:42.001704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b3aa8-ce4f-469b-973a-f3e6f034dcaa None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.002003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b3aa8-ce4f-469b-973a-f3e6f034dcaa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.002285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b3aa8-ce4f-469b-973a-f3e6f034dcaa None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.003714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 35/75] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:42.004364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b3aa8-ce4f-469b-973a-f3e6f034dcaa None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.019271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.019954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.020239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.020518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.039469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.040966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.042770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 41/76] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:41 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:42.043603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.133091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b3aa8-ce4f-469b-973a-f3e6f034dcaa None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.152510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54717998-be10-4564-acc9-341533e6ad38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.173281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.173918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.174204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.174488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.175221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:42.175523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.176975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a395f0-3fab-4b1f-bbe0-afd50a6babea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.179395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.185174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.185984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 36/77] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:42.187191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.187479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.187753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.197710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.198384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.198671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.198951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.200163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.201790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.204011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 42/78] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:42.205138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.208562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:42.209847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:42.287700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 37/79] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:42.288975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.314366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0bdc6-9b23-4e29-81b6-849ca4759b88 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.353371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.354030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.354318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.354598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.366007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:42.371013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:42.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:42.372972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 43/80] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:42.373825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.416750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17f230-c550-4bcd-af52-08842a73e825 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.434417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.445116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.454220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.454850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.457125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.457125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.491645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6de0a-4162-48c0-875e-7628396ad2a9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.528925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.530994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.531183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.531914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.532289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.532652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.534322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.536093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.537969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 44/81] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:42.538708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.652662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 38/82] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:42.653274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a448eb07-6374-43d8-ac64-b399083df396 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.657839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.676351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.687542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.693515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.693923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.695170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.695170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.770224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.771718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.772007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b6af0-68b6-4cf8-90b5-5de5f4a90488 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.810389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.811905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.812174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.813357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.814818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.816633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 39/83] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:42.817247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.892550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 45/84] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:42.897334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:42.917476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.924502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:42.932508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120ad7-3792-4a69-9c25-0a18553200c0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:42.974160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:42.974792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:42.975073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:42.975345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:42.976067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:42.976371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:42.977853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:42.986331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 40/85] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:42.987145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.010027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d68d7-0b33-4f61-9686-66b458c091ef None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.044554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.045207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.045525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.045792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.087553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171bcbd-df2b-4c88-b9f7-9446895baac7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.112945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.114427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.120722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.121404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.121694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.121985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.123162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.125187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.126891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 41/86] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:43.126891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.141513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:43.155506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:43.219601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 46/87] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:43.220375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.235173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f7f4e-49b3-4c8f-bd91-1272051fa766 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.269540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.270156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.270437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.270711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.271380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.272876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.293037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 42/88] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:11:43 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:43.293858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.321753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7d68c-540a-46bf-826d-e9003b1fef3f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.344203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:43.361667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.362339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.362625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.362902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.364165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.365719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.367513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 47/89] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:43.368343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.423601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:43.449063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e76e8-4620-453c-a1ea-083bc6926d1d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.491109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7893-1bf1-4cb3-bda6-09a2cb623279 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.491367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.494972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.494972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.494972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.494972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.495308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.499607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 43/90] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:43.499607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.537443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.538438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.538929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.539388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.540383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=ac5ae9b9caeb4dc28abf48c1aece3594) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:43.540702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.542204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.550520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 48/91] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/role_assignments?user.id=ac5ae9b9caeb4dc28abf48c1aece3594&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:43.551206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.651606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159c74-e588-4300-a772-d6043c608121 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.654604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:43.708538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.709275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.709561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.709841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.711158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.712666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.715800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 44/92] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:43.716671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.725443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f239cb14-f891-4daa-9b02-b3680b47fa23 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:43.747955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:43.774041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:43.775525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:43.775823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:43.776104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=3f82692456794f98aaedf11a512d650d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:43.778118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:43.781169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:43.789442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 49/93] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/role_assignments?user.id=3f82692456794f98aaedf11a512d650d&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:43.790219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:43.920628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54baf84-906a-4ca2-993a-a1fa0a2c71e0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:44.006728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:44.007292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:44.008759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:44.009073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:44.045181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84175718-6b08-4a71-b7e4-33c86f3dc807 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:44.086530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:44.110948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:44.112469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:44.122556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:44.123256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:44.123611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:44.123892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:44.124708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] RBAC: Adding query filter params (role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=ac5ae9b9caeb4dc28abf48c1aece3594) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:44.125064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:44.126543 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:44.133755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:44.150836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 50/94] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/role_assignments?user.id=ac5ae9b9caeb4dc28abf48c1aece3594&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 259 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:44.270272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 45/95] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:44.276272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:44.444329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b6d6d-0fe7-4603-8dd0-359bd11bb879 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:44.501632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecba15-5cca-4e74-9cc9-b858cdbac8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:44.502666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecba15-5cca-4e74-9cc9-b858cdbac8dc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:44.503149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecba15-5cca-4e74-9cc9-b858cdbac8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:44.503648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecba15-5cca-4e74-9cc9-b858cdbac8dc None admin] PATH_INFO: `/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:44.505237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecba15-5cca-4e74-9cc9-b858cdbac8dc None admin] RBAC: Authorizing `identity:get_project(project_id=c7e2a5fbbb8544cbabec3b16eb0b622b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:44.506898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecba15-5cca-4e74-9cc9-b858cdbac8dc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:44.508815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 51/96] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:44 2022] GET /identity/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b => generated 312 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:44.515073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:44.648449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cffeeb-448c-4f1d-aebb-d0d6b53fb713 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:44.671168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:44.695983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:44.696634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:44.696946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:44.697224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:44.698033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=c7e2a5fbbb8544cbabec3b16eb0b622b, user.id=ac5ae9b9caeb4dc28abf48c1aece3594) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:44.698347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:44.699856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe1ac5-cbd8-41de-8245-220fe2567326 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:44.706754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 46/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:44 2022] GET /identity/v3/role_assignments?user.id=ac5ae9b9caeb4dc28abf48c1aece3594&scope.project.id=c7e2a5fbbb8544cbabec3b16eb0b622b&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:46.288741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83cd6-caf7-4889-9d05-a1560eab405f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.289796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83cd6-caf7-4889-9d05-a1560eab405f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.290290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce83cd6-caf7-4889-9d05-a1560eab405f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.291903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 52/98] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:46.298066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386dcb-90ff-4095-8f94-22308132ea08 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.298951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386dcb-90ff-4095-8f94-22308132ea08 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.299469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f386dcb-90ff-4095-8f94-22308132ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.321429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5f386dcb-90ff-4095-8f94-22308132ea08 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:46.322971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5f386dcb-90ff-4095-8f94-22308132ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:46.351600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55397-8280-46ae-868a-ab1e290d6e9c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.351899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55397-8280-46ae-868a-ab1e290d6e9c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.352167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b55397-8280-46ae-868a-ab1e290d6e9c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.353573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 53/99] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:46.359850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.360140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.360422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.392232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:46.393684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:46.422939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 47/100] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:46.432406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10984-8c04-41ae-891d-684d4af50b0e None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.432712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10984-8c04-41ae-891d-684d4af50b0e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.432998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff10984-8c04-41ae-891d-684d4af50b0e None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.434378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 48/101] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:46.446333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.446651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.446898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.479899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:46.481398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:46.513218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:46.555977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 54/102] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:46.558564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:46.633110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 49/103] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:46.634309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:46.674464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c05ed-d5fa-47c2-94eb-f03777edab47 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:46.713907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:46.714584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.714875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.715156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.716442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:46.718606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:46.720554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 55/104] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:46.725707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:46.729818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:46.793232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ecc7-ab78-4f6f-8724-f3d205f74771 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:46.833058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:46.833904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:46.834669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:46.835066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:46.835425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:46.848608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:46.853782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:46.854686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:46.855755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 50/105] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:46.859394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:46.969873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda00620-9e91-4c95-b842-be6a28660bdc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:46.982239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d29445-efde-47af-9536-10fc007d37d7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:46.984568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.020210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.020906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.021384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.021800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.024792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa93c6-e71b-4f47-88ab-12154eeec7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.025701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa93c6-e71b-4f47-88ab-12154eeec7b1 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.026194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa93c6-e71b-4f47-88ab-12154eeec7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.026654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa93c6-e71b-4f47-88ab-12154eeec7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.027574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa93c6-e71b-4f47-88ab-12154eeec7b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:47.033002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa93c6-e71b-4f47-88ab-12154eeec7b1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:47.034348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:47.040195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:47.041136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:47.041919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 56/106] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:47.042627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.068505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 51/107] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:11:46 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:47.070454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37dbc7-e5b7-4d83-9841-f781d2e3e9b7 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.071009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37dbc7-e5b7-4d83-9841-f781d2e3e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.071505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37dbc7-e5b7-4d83-9841-f781d2e3e9b7 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.073909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 52/108] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:47.079686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37dbc7-e5b7-4d83-9841-f781d2e3e9b7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.256287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546a8e3-1ecc-44e0-a87f-baf5d6c3b6d4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.268782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.289194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37dbc7-e5b7-4d83-9841-f781d2e3e9b7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.321184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.321885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.322126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.322403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.323200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:47.323657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:47.325246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8a79e0-36d1-4453-ab0a-346320fb66ce None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:47.335785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 57/109] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:47.338468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.338468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.338468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.347108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.348482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.349035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.349532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.350515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:47.351054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:47.352889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:47.362542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:47.363763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:47.365082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 53/110] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:47.366367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.390431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.457657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 58/111] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:47.458569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.503489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956885d-5dc9-4fb3-818c-eacef285fa4a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.544650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717f7a8-4fe9-4712-acd9-fb7b244b7646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.546238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717f7a8-4fe9-4712-acd9-fb7b244b7646 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.546766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717f7a8-4fe9-4712-acd9-fb7b244b7646 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.547244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717f7a8-4fe9-4712-acd9-fb7b244b7646 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.548782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717f7a8-4fe9-4712-acd9-fb7b244b7646 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:47.550583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717f7a8-4fe9-4712-acd9-fb7b244b7646 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:47.552536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 54/112] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:47.554156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72395c19-c52d-4481-8ac5-31a326bf02b8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.554757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72395c19-c52d-4481-8ac5-31a326bf02b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.555283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72395c19-c52d-4481-8ac5-31a326bf02b8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.557124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 55/113] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:47.558068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72395c19-c52d-4481-8ac5-31a326bf02b8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.603727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.609113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1046fb1-fd93-46ba-86be-fc6b268d84f6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.652865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.654502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.654825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.655111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] PATH_INFO: `/v3/users/4bf37f98833c4fd3b41893a1af49732a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.672164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=4bf37f98833c4fd3b41893a1af49732a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:47.672721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.673705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:47.675448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 59/114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/users/4bf37f98833c4fd3b41893a1af49732a => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:47.676321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.698328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72395c19-c52d-4481-8ac5-31a326bf02b8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.736092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e66635-5818-4332-9c7d-421280675a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.736751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66635-5818-4332-9c7d-421280675a74 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.737068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66635-5818-4332-9c7d-421280675a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.737357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e66635-5818-4332-9c7d-421280675a74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.748300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e66635-5818-4332-9c7d-421280675a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-59e66635-5818-4332-9c7d-421280675a74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:47.753884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:47.754764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:47.755547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 56/115] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:47.761141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.761430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.761708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.780475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:47.781723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:47.793916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aba94d-e7b6-4fbf-a422-6ae13710e1c0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.830856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622730af-6820-434b-ad43-5c62cf26b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:47.831520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622730af-6820-434b-ad43-5c62cf26b014 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.831798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622730af-6820-434b-ad43-5c62cf26b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.832076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622730af-6820-434b-ad43-5c62cf26b014 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.833372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622730af-6820-434b-ad43-5c62cf26b014 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:47.834844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622730af-6820-434b-ad43-5c62cf26b014 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:47.836884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 60/116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:47.837737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d824-9664-45b8-87a7-d9da2b1fe0f2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:47.838021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d824-9664-45b8-87a7-d9da2b1fe0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:47.838294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d824-9664-45b8-87a7-d9da2b1fe0f2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:47.839713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 61/117] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:47.840202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d824-9664-45b8-87a7-d9da2b1fe0f2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.867511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.868621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 57/118] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:47.869535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:47.964379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:47.971042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d824-9664-45b8-87a7-d9da2b1fe0f2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:47.992107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c935a-25eb-4790-9e38-c9c1f4bc443f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.011067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.011699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.011979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.012315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.031064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.031706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.031999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.032285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.033045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:48.033364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.034750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.044188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 58/119] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:48.045905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.095366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.096748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.125517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.152376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea50be-bca4-4638-b6ee-2c733453b869 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.189346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15956f97-55c8-4dad-9d3c-edbf4e2e433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.190026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956f97-55c8-4dad-9d3c-edbf4e2e433c None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.190315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956f97-55c8-4dad-9d3c-edbf4e2e433c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.190594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15956f97-55c8-4dad-9d3c-edbf4e2e433c None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92/users/ac5ae9b9caeb4dc28abf48c1aece3594/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.192604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956f97-55c8-4dad-9d3c-edbf4e2e433c None admin] RBAC: Authorizing `identity:create_grant(project_id=96753d928a2342e69f156ffb28c8de92, user_id=ac5ae9b9caeb4dc28abf48c1aece3594, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.194114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15956f97-55c8-4dad-9d3c-edbf4e2e433c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.197158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.207723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 59/120] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:11:48 2022] PUT /identity/v3/projects/96753d928a2342e69f156ffb28c8de92/users/ac5ae9b9caeb4dc28abf48c1aece3594/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:11:48.209030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.209323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.209683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.221422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 62/121] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:48.222908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.239649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:48.241163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:48.336197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 60/122] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:48.337725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.349421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cdc24-c374-4935-a64c-1862fe7f6f23 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.385353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.398945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.399770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.400055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.400332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.414147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:48.420016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:48.421112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:48.422137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 63/123] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:48.422782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.492483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e5618-0152-4b65-bc59-1c8befce2ea6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.523931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.535387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.536497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.537016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.537514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.539000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.540901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.547542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c9db0e-c82e-4784-b261-6d4953bfee7a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.547918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 61/124] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:48.549004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.581063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.581654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.581949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.582229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.583518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.584950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.586716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 64/125] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:48.587474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.642616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.664756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406dee-61ce-4bde-ace9-a6a8fde14af4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.691523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94821f-1b4a-40c1-bc3b-0e9f886c75d5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.702728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.703755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.704273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.704782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:48.723477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:48.724347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:48.725179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:48.727826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 62/126] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:48.729010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.736798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.737468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.737753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.738032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.738770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:48.739079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.740470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.749288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 65/127] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:48.753021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.801232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.845791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aaff6-8b65-42c7-9ae1-5e3d733f7834 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.878158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0ee6d-2368-472d-a8fd-59d6835b7b65 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:48.891952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.893222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.894114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:48.894871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.895445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.897338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.900056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.902616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 63/128] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:48.903553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:48.923892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:48.924743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:48.925162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:48.925542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:48.926513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] RBAC: Adding query filter params (role.id=cec2e3395ae24dacaaeffb6b77cfc409, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=4bf37f98833c4fd3b41893a1af49732a) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:48.927166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:48.928758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:48.935237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 66/129] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/role_assignments?user.id=4bf37f98833c4fd3b41893a1af49732a&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=cec2e3395ae24dacaaeffb6b77cfc409 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:48.936822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.117348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbae0e8-878e-4e16-b1d0-21b467a078d6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.143339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b14d-165f-4d0a-a4ec-8e35be0b5259 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.156113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:49.171260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.171920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.172201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.172549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.173237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:49.173545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.180917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.184653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 64/130] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:49.186544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.222206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.223158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.223581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.224003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.225391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.227030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.228950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 67/131] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:48 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:49.229874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.287988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:49.304171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f9f1e-e8c2-4b68-9a08-14aa63016913 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.348866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.348866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.348866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.348866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92/users/3f82692456794f98aaedf11a512d650d/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.349338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] RBAC: Authorizing `identity:create_grant(project_id=96753d928a2342e69f156ffb28c8de92, user_id=3f82692456794f98aaedf11a512d650d, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.349338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.363737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 65/132] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:11:49 2022] PUT /identity/v3/projects/96753d928a2342e69f156ffb28c8de92/users/3f82692456794f98aaedf11a512d650d/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:11:49.364712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.417180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a598-40c0-42f3-90d6-2f4c5a2a5712 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.429596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:49.497460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e320d-3241-4aef-a38b-96a1fe7c2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.498069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e320d-3241-4aef-a38b-96a1fe7c2a3a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.498926 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e320d-3241-4aef-a38b-96a1fe7c2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.499204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e320d-3241-4aef-a38b-96a1fe7c2a3a None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.500521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e320d-3241-4aef-a38b-96a1fe7c2a3a None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.502061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e320d-3241-4aef-a38b-96a1fe7c2a3a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.503814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 68/133] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:49 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:49.508489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930b6f1-f877-4b9f-a307-cbd0cb4d913c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.509253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857f7e-7fd5-4fb3-848f-eb7e3be06746 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.509610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857f7e-7fd5-4fb3-848f-eb7e3be06746 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.509931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857f7e-7fd5-4fb3-848f-eb7e3be06746 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.511546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 69/134] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:49.514823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857f7e-7fd5-4fb3-848f-eb7e3be06746 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.556259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaab35-999e-4c9a-9df3-aeccf5714211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.557213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaab35-999e-4c9a-9df3-aeccf5714211 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.557640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaab35-999e-4c9a-9df3-aeccf5714211 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.558092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaab35-999e-4c9a-9df3-aeccf5714211 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.559541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaab35-999e-4c9a-9df3-aeccf5714211 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.561377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaab35-999e-4c9a-9df3-aeccf5714211 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.563447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 66/135] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:49 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:49.565658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.566206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.566628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.588895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:49.590470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:49.679652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 67/136] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:49.680724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.721758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce857f7e-7fd5-4fb3-848f-eb7e3be06746 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.736873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:49.742932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:49.770653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.771492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.772506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.772944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] PATH_INFO: `/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.774584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e2a5fbbb8544cbabec3b16eb0b622b)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.776430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.779457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 70/137] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:49 2022] GET /identity/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:49.780902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:49.814542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5a3b5-de71-412b-91c0-482932d51004 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.890861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:49.891822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:49.892244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:49.892685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92/users/ac5ae9b9caeb4dc28abf48c1aece3594/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:49.898778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] RBAC: Authorizing `identity:create_grant(project_id=96753d928a2342e69f156ffb28c8de92, user_id=ac5ae9b9caeb4dc28abf48c1aece3594, role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:49.900475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:49.913891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7227dd3-5269-4fd5-880b-fabb8a6fbca7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:49.937456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 68/138] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:11:49 2022] PUT /identity/v3/projects/96753d928a2342e69f156ffb28c8de92/users/ac5ae9b9caeb4dc28abf48c1aece3594/roles/73a9432602da4fa9aed56acc5eae9592 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:11:49.938589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:50.014638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:50.015953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:50.016819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:50.017489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:50.021165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:50.024477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:50.028910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 71/139] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:50.035693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:50.135997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:50.229597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16812ad-fc59-4404-94b2-1acb39c0e450 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:50.274017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c084-7115-4f05-8ea0-020e0070406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:50.275334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c084-7115-4f05-8ea0-020e0070406d None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:50.275832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c084-7115-4f05-8ea0-020e0070406d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:50.276338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c084-7115-4f05-8ea0-020e0070406d None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:50.277325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c084-7115-4f05-8ea0-020e0070406d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:50.280412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c084-7115-4f05-8ea0-020e0070406d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:50.300869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd442ef-6c83-41d0-8202-919ab3425823 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:50.303686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:50.335135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 72/140] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:11:50 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:11:50.357726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441de25-dd8b-4a74-9e7b-9c4c5795a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:50.358504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441de25-dd8b-4a74-9e7b-9c4c5795a48b None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:50.358790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441de25-dd8b-4a74-9e7b-9c4c5795a48b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:50.359127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441de25-dd8b-4a74-9e7b-9c4c5795a48b None admin] PATH_INFO: `/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b/users/ac5ae9b9caeb4dc28abf48c1aece3594/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:50.361601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441de25-dd8b-4a74-9e7b-9c4c5795a48b None admin] RBAC: Authorizing `identity:create_grant(project_id=c7e2a5fbbb8544cbabec3b16eb0b622b, user_id=ac5ae9b9caeb4dc28abf48c1aece3594, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:50.363335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441de25-dd8b-4a74-9e7b-9c4c5795a48b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:50.381107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 69/141] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:11:49 2022] PUT /identity/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b/users/ac5ae9b9caeb4dc28abf48c1aece3594/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:11:50.940872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b7e0-1405-4045-82fb-852463c39c5e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:50.941382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b7e0-1405-4045-82fb-852463c39c5e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:50.941725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524b7e0-1405-4045-82fb-852463c39c5e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:50.943455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 73/142] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:50.951379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a455261-54f2-4d52-9408-81e89717888d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:50.952237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a455261-54f2-4d52-9408-81e89717888d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:50.952708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a455261-54f2-4d52-9408-81e89717888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:50.981993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4a455261-54f2-4d52-9408-81e89717888d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:50.984109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4a455261-54f2-4d52-9408-81e89717888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:51.091221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 70/143] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:51.123955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524b7e0-1405-4045-82fb-852463c39c5e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.283412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524b7e0-1405-4045-82fb-852463c39c5e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:51.291458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:51.325225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722243d9-606f-4f04-83e3-9ed58ab164d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:51.325893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722243d9-606f-4f04-83e3-9ed58ab164d9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722243d9-606f-4f04-83e3-9ed58ab164d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.326537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722243d9-606f-4f04-83e3-9ed58ab164d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.338257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722243d9-606f-4f04-83e3-9ed58ab164d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-722243d9-606f-4f04-83e3-9ed58ab164d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:51.343878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:51.344715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:51.345517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:51.347475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 74/144] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:51.353524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a455261-54f2-4d52-9408-81e89717888d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.385234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445aa77-5380-4a9c-802f-f9d307185724 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.385803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445aa77-5380-4a9c-802f-f9d307185724 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.386241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445aa77-5380-4a9c-802f-f9d307185724 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.388154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 75/145] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:51.394660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.396610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.397105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.425198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:51.426703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:51.484378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:51.501710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a455261-54f2-4d52-9408-81e89717888d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:51.528176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 76/146] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:51.548451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:51.549128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.549478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.549820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.550627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:51.551000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:51.552468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:51.556436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.567534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 71/147] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:51.571950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.683281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:51.689035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb6a2a-f9ed-470c-add0-2cb03618ffd7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:51.698524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6880bab-480c-4791-aa03-825289467b59 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:51.743482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:51.744524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.745030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.745606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.749138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:51.749794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.750077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.750345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.755263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:51.756897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:51.758893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 72/148] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:51.759236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:51.764421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:51.766304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:51.767189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:11:51.767962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:51.770301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 77/149] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:11:51.776319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.797309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:51.903158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0cbcf4-6a83-4126-8449-b6c975939bc9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:51.906830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64429ca4-e25b-49e0-a596-c050487c7690 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:51.943687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:51.947410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:51.948633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.950865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:51.950865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.950865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.952136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:51.952670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:51.953652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:51.954159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:51.955910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:51.966107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 78/150] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:51.972586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:51.995177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:52.041760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:52.042884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:52.069104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:52.091120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d8ca7-fe3c-440f-8070-a103dad9dd84 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:52.130855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:52.131841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.132373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.132966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] PATH_INFO: `/v3/users/4bf37f98833c4fd3b41893a1af49732a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.134550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] RBAC: Authorizing `identity:get_user(user_id=4bf37f98833c4fd3b41893a1af49732a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:52.136369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:52.140193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 79/151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/users/4bf37f98833c4fd3b41893a1af49732a => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:52.145368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:52.153885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 73/152] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:11:52.161038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:52.257296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:52.265530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f289b9e-1cb0-4ace-b71d-ef3c986fedf8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:52.272939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ee79d-de0a-40a5-8e3c-978be327854d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:52.299086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:52.311521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:52.312691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.313167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f773d-944d-4b10-9c82-e957b5673b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:52.313349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.313797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.314107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f773d-944d-4b10-9c82-e957b5673b81 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.314485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f773d-944d-4b10-9c82-e957b5673b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.314828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f773d-944d-4b10-9c82-e957b5673b81 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.315997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:52.316245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f773d-944d-4b10-9c82-e957b5673b81 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:52.317876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f773d-944d-4b10-9c82-e957b5673b81 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:52.318209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:52.320049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 74/153] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:52 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:52.323486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99bbc-519b-4ae3-93b8-988c7bafc961 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.323486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99bbc-519b-4ae3-93b8-988c7bafc961 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.323486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb99bbc-519b-4ae3-93b8-988c7bafc961 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.323486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 75/155] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:52.323930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 80/155] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:52 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:52.330923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:52.331258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99bbc-519b-4ae3-93b8-988c7bafc961 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:52.443928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1feed7-07ee-40ab-b2fc-5089b9938e1d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:52.479028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb99bbc-519b-4ae3-93b8-988c7bafc961 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:52.502528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3864f-a481-48b1-8d9f-00c3394f41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:52.503215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3864f-a481-48b1-8d9f-00c3394f41fa None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.503498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3864f-a481-48b1-8d9f-00c3394f41fa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.503769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3864f-a481-48b1-8d9f-00c3394f41fa None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92/users/4bf37f98833c4fd3b41893a1af49732a/roles/cec2e3395ae24dacaaeffb6b77cfc409` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.506703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3864f-a481-48b1-8d9f-00c3394f41fa None admin] RBAC: Authorizing `identity:create_grant(project_id=96753d928a2342e69f156ffb28c8de92, user_id=4bf37f98833c4fd3b41893a1af49732a, role_id=cec2e3395ae24dacaaeffb6b77cfc409)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:52.508172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3864f-a481-48b1-8d9f-00c3394f41fa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:52.536263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 81/156] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:11:52 2022] PUT /identity/v3/projects/96753d928a2342e69f156ffb28c8de92/users/4bf37f98833c4fd3b41893a1af49732a/roles/cec2e3395ae24dacaaeffb6b77cfc409 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:11:52.543173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.543498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.543788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.554678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:52.555307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.555588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.555862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.556672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=ac5ae9b9caeb4dc28abf48c1aece3594) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:52.561307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:52.562932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:52.575263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 76/157] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:52 2022] GET /identity/v3/role_assignments?user.id=ac5ae9b9caeb4dc28abf48c1aece3594&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:52.582959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:52.584239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:52.604088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:52.697738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 82/158] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:52.738590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:52.830377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:52.885138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02007f80-1838-4639-a60d-eeb375bed600 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:52.924598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:52.925294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:52.925574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:52.925846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:52.939747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:52.948961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:52.949865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:52.950687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 77/159] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:52.956501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:53.070479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5b93e-d7fa-457c-a632-544c675208f0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:53.112111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:53.112752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:53.113063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:53.113332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:53.114158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:53.114459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:53.115847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:53.129018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 83/160] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:53.130835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:53.252389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bd1f-115c-4a1d-9c3e-e865b160bcd9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:53.267570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:53.293247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88200aa-4106-4b80-9e0f-52914b199f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:53.293906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88200aa-4106-4b80-9e0f-52914b199f4e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:53.294187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88200aa-4106-4b80-9e0f-52914b199f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:53.294449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88200aa-4106-4b80-9e0f-52914b199f4e None admin] PATH_INFO: `/v3/users/3f82692456794f98aaedf11a512d650d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:53.295699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88200aa-4106-4b80-9e0f-52914b199f4e None admin] RBAC: Authorizing `identity:get_user(user_id=3f82692456794f98aaedf11a512d650d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:53.297209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88200aa-4106-4b80-9e0f-52914b199f4e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:53.298834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 78/161] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:53 2022] GET /identity/v3/users/3f82692456794f98aaedf11a512d650d => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:53.304311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:53.314513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:53.433686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f3472-5a54-4626-bcc5-9e016908d99e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:53.479235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:53.479954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:53.480233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:53.480816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:53.512909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00941-e4d1-4609-b338-3b9372afebc1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:53.513113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00941-e4d1-4609-b338-3b9372afebc1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:53.513370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b00941-e4d1-4609-b338-3b9372afebc1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:53.515375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 79/162] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:53.521198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9437-32af-4642-915f-867bc200099d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:53.521465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9437-32af-4642-915f-867bc200099d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:53.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef9437-32af-4642-915f-867bc200099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:53.552576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f1ef9437-32af-4642-915f-867bc200099d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:53.553808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f1ef9437-32af-4642-915f-867bc200099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:53.602920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:53.604410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:53.615653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:53.711764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 80/163] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:53.819492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 84/164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:53.825342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9437-32af-4642-915f-867bc200099d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:53.860596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:54.017335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef9437-32af-4642-915f-867bc200099d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:54.047564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:54.056296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5e2b6-59ff-498d-b985-eb0dade15e77 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:54.064989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:54.078602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:54.079586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:54.080057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:54.080521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:54.082023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:54.083892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:54.086105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 81/165] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:53 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:54.108501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:54.110754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:54.111473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:54.111820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:54.112168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:54.123268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:54.128365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:54.129512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:54.130448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 85/166] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:11:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:11:54.136293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:54.243866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413425fc-9bfc-4b13-9a03-8faa2b0dd5e8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:54.278188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:54.278915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:54.279283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:54.280155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:54.280976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:54.281345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:54.282806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:54.285942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be110202-2138-46b5-bf99-f336f9a588f0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:54.291584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 86/167] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:11:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:54.297515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:54.326309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:54.351662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:54.352601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:54.353100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:54.353545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:54.354638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=3f82692456794f98aaedf11a512d650d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:54.355121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:54.357194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:54.369944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 82/168] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:54 2022] GET /identity/v3/role_assignments?user.id=3f82692456794f98aaedf11a512d650d&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:54.414565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0856d-89e4-45f8-8e91-af529feaeec5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:54.458122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:54.458783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:54.459060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:54.459333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:54.460521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:54.462057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:54.464102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 87/169] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:54 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:54.470428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:54.526482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:54.594229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853130f5-53a6-4649-8bbe-0b48d58dd98a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:54.640766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:54.641343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:54.641621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:54.641899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:54.739035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:54.740549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:54.798551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:54.865341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 83/170] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:54.870936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:54.974680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:54.985134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d538bd8-6b68-4ee7-89ca-cf77d4cf6864 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:55.028297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924331fb-ecf1-4741-9462-8ec6a27a72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:55.028982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924331fb-ecf1-4741-9462-8ec6a27a72ec None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.029284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924331fb-ecf1-4741-9462-8ec6a27a72ec None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.029588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924331fb-ecf1-4741-9462-8ec6a27a72ec None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.030770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924331fb-ecf1-4741-9462-8ec6a27a72ec None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:55.032232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924331fb-ecf1-4741-9462-8ec6a27a72ec None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:55.034109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 88/171] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:54 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:55.039843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:55.149249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb66f19-9cfb-4a6c-a6cc-c2898296d49e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:55.185129 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:55.186332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.186645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.187069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.187669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] RBAC: Adding query filter params (role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=ac5ae9b9caeb4dc28abf48c1aece3594) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:55.187973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:55.189464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed0d6-c964-4fc7-9338-01e78b47aca8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:55.195987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 84/172] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:55 2022] GET /identity/v3/role_assignments?user.id=ac5ae9b9caeb4dc28abf48c1aece3594&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:55.254561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce9f3e-381b-4328-8dd5-2f74ffaceef8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.255052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce9f3e-381b-4328-8dd5-2f74ffaceef8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.255052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce9f3e-381b-4328-8dd5-2f74ffaceef8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.256391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 89/173] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:55.263106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.263473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.263653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.290089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:55.291317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:55.293670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:55.380877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 85/174] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:55.416354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce9f3e-381b-4328-8dd5-2f74ffaceef8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:55.539051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce9f3e-381b-4328-8dd5-2f74ffaceef8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:55.576589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:55.577277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.577552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.577824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.588986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:55.594911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:55.595877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:55.596690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 90/175] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:55.602045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:55.717516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b77c4f-bc27-41dc-ae4b-3fadd52717ae None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:55.754324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:55.754950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.755229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.755498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.756216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:55.756515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:55.757940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2362dcd-3819-485d-a24e-d2f6369aea43 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:55.763487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:55.771483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 86/176] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:55.774004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:55.805119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:55.861733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1880f85-0875-4bc4-ad83-545079d199b8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.862042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1880f85-0875-4bc4-ad83-545079d199b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.862275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1880f85-0875-4bc4-ad83-545079d199b8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.863651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 87/177] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:55.869178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bf147-e6d4-4209-85ab-85545c65e06c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.869455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bf147-e6d4-4209-85ab-85545c65e06c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.869900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bf147-e6d4-4209-85ab-85545c65e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.904461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9cc6-7edf-4a33-8fa5-edcf6093c6f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:55.909944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-899bf147-e6d4-4209-85ab-85545c65e06c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:55.911164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-899bf147-e6d4-4209-85ab-85545c65e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:55.951114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad9cfa-b7c8-48bd-890e-5f0159b3da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:55.952245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9cfa-b7c8-48bd-890e-5f0159b3da36 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.952725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9cfa-b7c8-48bd-890e-5f0159b3da36 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.953040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad9cfa-b7c8-48bd-890e-5f0159b3da36 None admin] PATH_INFO: `/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.954888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad9cfa-b7c8-48bd-890e-5f0159b3da36 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5ae9b9caeb4dc28abf48c1aece3594)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:55.956810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad9cfa-b7c8-48bd-890e-5f0159b3da36 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:55.959505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 91/178] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:55 2022] GET /identity/v3/users/ac5ae9b9caeb4dc28abf48c1aece3594 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:55.960863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24684-b21a-42d1-8a9e-1120b1f87016 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:55.961192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24684-b21a-42d1-8a9e-1120b1f87016 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:55.961426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24684-b21a-42d1-8a9e-1120b1f87016 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:55.962954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 92/179] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:55.965540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24684-b21a-42d1-8a9e-1120b1f87016 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.024963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 88/180] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:56.027914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63bc3e-83c0-4bac-9f6d-2c9e1897ff4e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.030837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63bc3e-83c0-4bac-9f6d-2c9e1897ff4e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.031332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63bc3e-83c0-4bac-9f6d-2c9e1897ff4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.058716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fd63bc3e-83c0-4bac-9f6d-2c9e1897ff4e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:56.060491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fd63bc3e-83c0-4bac-9f6d-2c9e1897ff4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:56.096793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.109674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24684-b21a-42d1-8a9e-1120b1f87016 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.138829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 89/181] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:56.140361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4f00-4592-46e3-b0a5-6900e2b57a4b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.140610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4f00-4592-46e3-b0a5-6900e2b57a4b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.140856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa4f00-4592-46e3-b0a5-6900e2b57a4b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.142294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 90/182] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:56.142910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4f00-4592-46e3-b0a5-6900e2b57a4b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.151378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.152334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.153003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.153563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.206057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.226563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:56.228128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:56.251883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa4f00-4592-46e3-b0a5-6900e2b57a4b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.288629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607cb9e-e0e3-452d-abab-66c301d1344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.289324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607cb9e-e0e3-452d-abab-66c301d1344f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.289606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607cb9e-e0e3-452d-abab-66c301d1344f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.289886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607cb9e-e0e3-452d-abab-66c301d1344f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.302026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607cb9e-e0e3-452d-abab-66c301d1344f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7607cb9e-e0e3-452d-abab-66c301d1344f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:56.307154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:56.308116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:56.309004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 91/183] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:56.309713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dafce-1d5a-4566-8bf7-1fdf564da4fd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.309997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dafce-1d5a-4566-8bf7-1fdf564da4fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.310275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dafce-1d5a-4566-8bf7-1fdf564da4fd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.311913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 92/184] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:56.312975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.313213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.313751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.329827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.332357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:56.333632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:56.340373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 93/185] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:56.341292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.409400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 93/186] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:56.410268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.453094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745d230-3b51-4b8f-a132-ce6068a455a5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.469548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.489000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e45bc-e233-44d5-ae44-d944aed41211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.489642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e45bc-e233-44d5-ae44-d944aed41211 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.489916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e45bc-e233-44d5-ae44-d944aed41211 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.490183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e45bc-e233-44d5-ae44-d944aed41211 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.491321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e45bc-e233-44d5-ae44-d944aed41211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:56.492753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e45bc-e233-44d5-ae44-d944aed41211 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:56.494391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:56.495654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.495933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.496198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.515427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:56.516631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:56.522713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727edd-bb65-425b-8035-03074a913a6a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.556688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.557338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.557618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.557892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.558604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:56.558908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:56.560351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:56.569054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:56.569863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.573966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.585740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 95/189] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:11:56.586457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.671638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f16bf-eccf-45b6-b713-21b0e74ec555 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.685028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.687625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998307e-f4bb-474b-b7d8-844d3c94470f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.706918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.707565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.707844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.708119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] PATH_INFO: `/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.709324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] RBAC: Authorizing `identity:get_project(project_id=c7e2a5fbbb8544cbabec3b16eb0b622b)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:56.710778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:56.712462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 95/190] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/projects/c7e2a5fbbb8544cbabec3b16eb0b622b => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:56.713237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.728152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.728809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.729140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.729416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.740339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:56.745393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:56.746405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:11:56.747195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 96/191] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:56.752338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.802397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:56.816495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214d46-7cc1-4870-b250-58e106e6ea93 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.851047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.851662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.851939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.852213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.852442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8b50-2221-4644-8b6f-0aea2952a009 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:56.852930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:56.854392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:56.875240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 96/192] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:11:56 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:11:56.877752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.888144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:56.889392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:56.889679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:56.889954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] PATH_INFO: `/v3/users/22dd60f795a745eba0cbc0d21264ef67` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:56.907902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] RBAC: Authorizing `identity:get_user(user_id=22dd60f795a745eba0cbc0d21264ef67)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:56.909489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:56.911284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 97/193] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/users/22dd60f795a745eba0cbc0d21264ef67 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:56.916786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:56.934351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.017576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9d4b84-93b3-4ea8-a432-3b2174e56f68 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.045542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913563-2070-49cd-83d3-ccbf05d363fc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.055321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.063119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.063806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.064086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.064357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.080190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:11:57.086009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:11:57.087660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 97/194] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:11:57.088628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.089397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.089397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.089397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.089600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.090771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=c7e2a5fbbb8544cbabec3b16eb0b622b, user.id=ac5ae9b9caeb4dc28abf48c1aece3594) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:57.091084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.092710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.101696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:56 2022] GET /identity/v3/role_assignments?user.id=ac5ae9b9caeb4dc28abf48c1aece3594&scope.project.id=c7e2a5fbbb8544cbabec3b16eb0b622b&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:57.101696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.236224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.244997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18671dde-5d39-438e-86d3-a979f840c6a1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.256880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0512ab-14b0-4a7d-a168-231726d3eae1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.304018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.304670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.308860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.308860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.308860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:57.308860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.309185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.309185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.309185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.309185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.309442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.320545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:57.321563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.355329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.384746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.386251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.445192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ee7d-e69e-4db5-bee1-3509b7226924 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.487127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.487765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.488051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.488330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.490015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:57.490330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.491854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.496391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 99/197] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:57.497282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.506541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 99/198] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:57.507410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.535518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.581203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.607540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92d54b-9929-402d-8bed-8a5272e2b0d2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.621202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92484d-21c9-44e1-b48f-a2e9ff51f9a7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.649830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.650643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.651253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.651632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] PATH_INFO: `/v3/users/4bf37f98833c4fd3b41893a1af49732a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.653619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] RBAC: Authorizing `identity:get_user(user_id=4bf37f98833c4fd3b41893a1af49732a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.656238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.658734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 100/199] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/users/4bf37f98833c4fd3b41893a1af49732a => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:57.660359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.665928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.666786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.667211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.667626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.669097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.671273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.673837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 100/200] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:57.675103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.783666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb45c1-7b04-41e6-a504-d98b784c6486 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.787328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.800721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4ff41-0d12-4cd5-8ec2-250ae2ff23bd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.824306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.825294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.825717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.826297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] PATH_INFO: `/v3/users/22dd60f795a745eba0cbc0d21264ef67` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.828278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd60f795a745eba0cbc0d21264ef67)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.830002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.832175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/users/22dd60f795a745eba0cbc0d21264ef67 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:57.833300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:57.838733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.839363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.839648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.839924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.845968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:57.917016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.918828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.944397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0c9d8-ec5b-4685-a41e-46a101dfe925 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:57.982684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:57.983460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:57.983842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:57.984218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:57.985248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=22dd60f795a745eba0cbc0d21264ef67) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:57.985898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:57.987321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:57.993465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 102/202] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/role_assignments?user.id=22dd60f795a745eba0cbc0d21264ef67&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:58.000875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:58.049905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:58.070761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 101/203] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:58.077742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:58.079676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:58.112895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34f8e8-24b7-4a58-a920-777f352ff7e6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:58.152143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:58.152779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:58.153105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:58.153382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:58.209228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e48221-cb65-475a-b741-c00ecbfcff5d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:58.231824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:58.234345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:58.250415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:58.251548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:58.252059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:58.252535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:58.254236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:58.256080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:58.258720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:58 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:58.265256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:58.313291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:58.327839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:58.348883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 103/205] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:11:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:11:58.354010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:58.391839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9942c1-024d-4bf8-b9dd-f31d82f3f2fe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:58.430083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:58.430714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:58.430997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:58.431272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:58.432070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] RBAC: Adding query filter params (role.id=cec2e3395ae24dacaaeffb6b77cfc409, scope.project.id=96753d928a2342e69f156ffb28c8de92, user.id=4bf37f98833c4fd3b41893a1af49732a) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:58.432381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:58.433893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:58.441055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 103/206] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:58 2022] GET /identity/v3/role_assignments?user.id=4bf37f98833c4fd3b41893a1af49732a&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=cec2e3395ae24dacaaeffb6b77cfc409 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:11:58.470803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd4ff8-b5bf-406c-84a1-fd8661aef719 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:58.511271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51eee-97dc-45f3-bcc1-13e3c5ebf382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:58.512363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51eee-97dc-45f3-bcc1-13e3c5ebf382 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:58.512941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51eee-97dc-45f3-bcc1-13e3c5ebf382 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:58.513451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51eee-97dc-45f3-bcc1-13e3c5ebf382 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:58.515229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a51eee-97dc-45f3-bcc1-13e3c5ebf382 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:58.517151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a51eee-97dc-45f3-bcc1-13e3c5ebf382 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:58.519556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:11:58 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:58.525356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:58.672781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a7c5-6096-4404-97ee-3d2e66808679 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:58.700152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:58.719281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:58.719904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:58.720182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:58.720454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:58.721344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] RBAC: Adding query filter params (role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=22dd60f795a745eba0cbc0d21264ef67) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:11:58.721603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:58.723034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05056088-5e89-4f15-b87a-64b731f40338 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:58.732475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:11:58 2022] GET /identity/v3/role_assignments?user.id=22dd60f795a745eba0cbc0d21264ef67&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:59.508311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824feb5-7a1a-49ed-88c0-e8328bd5a4b2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:59.509046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824feb5-7a1a-49ed-88c0-e8328bd5a4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:59.509046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824feb5-7a1a-49ed-88c0-e8328bd5a4b2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:59.510348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:11:59.516587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:59.517496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:59.517998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:59.537860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:11:59.539383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:11:59.641317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 105/210] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:11:59.666645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824feb5-7a1a-49ed-88c0-e8328bd5a4b2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:59.749331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:11:59.836230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824feb5-7a1a-49ed-88c0-e8328bd5a4b2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:11:59.885000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028edf9-8847-402a-a5d0-102c454c23d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:11:59.885969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028edf9-8847-402a-a5d0-102c454c23d6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:59.886399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028edf9-8847-402a-a5d0-102c454c23d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:59.886841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028edf9-8847-402a-a5d0-102c454c23d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:59.888306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028edf9-8847-402a-a5d0-102c454c23d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:11:59.890092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028edf9-8847-402a-a5d0-102c454c23d6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:11:59.892189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 106/211] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:11:59.897822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:11:59.975905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a54c-a242-413c-a5d7-723a1496c796 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:59.976236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a54c-a242-413c-a5d7-723a1496c796 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:59.976456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a54c-a242-413c-a5d7-723a1496c796 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:11:59.978060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 107/212] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:11:59.987275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:11:59.987812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:11:59.988320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.020215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:00.022892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:00.073652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343c878-747a-49c6-8096-d2dbceb88d30 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:00.095195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:00.128245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:00.130003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.130301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.130737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.131587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:00.137079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:00.168165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 106/213] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:11:59 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:12:00.176911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 108/214] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:00.203873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:00.334606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9dbf26-5e76-4fe7-b8aa-9f546aa920a2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:00.378433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a58c3-3ec3-459f-8fba-10dc2861789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:00.379556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a58c3-3ec3-459f-8fba-10dc2861789e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.380047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a58c3-3ec3-459f-8fba-10dc2861789e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.380525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a58c3-3ec3-459f-8fba-10dc2861789e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.394066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a58c3-3ec3-459f-8fba-10dc2861789e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-506a58c3-3ec3-459f-8fba-10dc2861789e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:00.401385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:00.402336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:00.403138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:00.411344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 107/215] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:00.413116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:00.460453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:00.511763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb45a1-5d40-4c3c-a0ec-8d22036482c2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.512094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb45a1-5d40-4c3c-a0ec-8d22036482c2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.512484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb45a1-5d40-4c3c-a0ec-8d22036482c2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.515234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 108/216] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:00.521199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.522195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.522573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.538955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d17b33-89cf-4bf0-929c-27d3d1785387 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:00.547834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:00.549075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:00.580424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:00.585280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:00.586256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.586754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.587266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.588006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:00.588375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:00.589765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:00.599154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 109/217] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:00.604952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:00.641214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 109/218] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:00.666278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:00.724438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:00.727950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7c12a-deb8-4747-9052-305facf3f12c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:00.769234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:00.769933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.770217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.770491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] PATH_INFO: `/v3/users/8322396336c7442c924ab450038169b0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.789449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] RBAC: Authorizing `identity:get_user(user_id=8322396336c7442c924ab450038169b0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:00.791442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:00.796931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 110/219] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:00 2022] GET /identity/v3/users/8322396336c7442c924ab450038169b0 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:00.801343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:00.803797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d6d66-5b19-4929-9088-3dc28eca7692 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:00.848623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:00.849306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:00.849584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:00.849857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:00.865270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:00.871900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:00.873029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:00.873974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:00.874619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 110/220] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:00.881821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:00.929306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:00.965313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509b05b-99ce-465c-8890-e029e85e52a6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.010917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce1ea3-7a69-43ee-b78b-6ad62ca17d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.011714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce1ea3-7a69-43ee-b78b-6ad62ca17d97 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.012001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce1ea3-7a69-43ee-b78b-6ad62ca17d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.012596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce1ea3-7a69-43ee-b78b-6ad62ca17d97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.074859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:01.092178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c912e04-d0b0-4a50-bab7-e6afb2a25e91 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.151831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce1ea3-7a69-43ee-b78b-6ad62ca17d97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.154102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce1ea3-7a69-43ee-b78b-6ad62ca17d97 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:01.164498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.165206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.165486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.165761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.166540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:01.166849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.168246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:01.186712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 111/221] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:01.193757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:01.329983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 111/222] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:12:01.331306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b7f4-9456-4e55-97de-af88ce06f759 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.331601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b7f4-9456-4e55-97de-af88ce06f759 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.331879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198b7f4-9456-4e55-97de-af88ce06f759 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.333710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 112/223] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:01.336781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b7f4-9456-4e55-97de-af88ce06f759 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:01.342499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:01.370047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6094-a1fa-447c-9870-02b5050ccc40 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.410567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957325a-0cc6-4427-aa03-542fb92d6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.411266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957325a-0cc6-4427-aa03-542fb92d6533 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.411547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957325a-0cc6-4427-aa03-542fb92d6533 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.411819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957325a-0cc6-4427-aa03-542fb92d6533 None admin] PATH_INFO: `/v3/users/22dd60f795a745eba0cbc0d21264ef67` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.413283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957325a-0cc6-4427-aa03-542fb92d6533 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd60f795a745eba0cbc0d21264ef67)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.415641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957325a-0cc6-4427-aa03-542fb92d6533 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:01.417665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 112/224] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:01 2022] GET /identity/v3/users/22dd60f795a745eba0cbc0d21264ef67 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:01.418475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:01.420092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.420947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.421493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.446549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:01.447947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:01.472724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198b7f4-9456-4e55-97de-af88ce06f759 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.517026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.518597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.519114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.519780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.521398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.523718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:01.531974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 113/225] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:01 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:01.533495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:01.540864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 113/226] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:01.540864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:01.634101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:01.662554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416194bf-dcdf-4bdd-a9c5-28e56607465f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.687651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc87dd9-1fc6-430f-aa12-48650a10edb2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.720115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.720643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.720990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.721241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.722049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=8322396336c7442c924ab450038169b0) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:01.722331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.724139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:01.731926 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 114/227] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:01 2022] GET /identity/v3/role_assignments?user.id=8322396336c7442c924ab450038169b0&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:01.732539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:01.735787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:01.750839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.751908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.752189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.752468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.754110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.755620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:01.758875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 114/228] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:01 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:01.765631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:01.945903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba771289-5040-420d-8435-6c6a3f1893bc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.948494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d364f-ae2e-4356-9057-90a6c0bf1629 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:01.986820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.987410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.987693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.987969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.990702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:01.991623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:01.992072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:01.992495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/22dd60f795a745eba0cbc0d21264ef67/roles/2b446efbd008435f977d0068496eb403` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:01.994704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] RBAC: Authorizing `identity:create_grant(project_id=9276e465f98d46f2afdff2ecf1dbad50, user_id=22dd60f795a745eba0cbc0d21264ef67, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:01.996592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:02.008047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:02.009063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:02.010208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 115/229] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:02.015351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:02.019688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:02.040636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 115/230] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:01 2022] PUT /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/22dd60f795a745eba0cbc0d21264ef67/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:12:02.136960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed0ff5-6640-448c-9ef9-b60161d1660d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:02.175147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:02.175795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.176074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.176348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.177188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:02.177494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:02.178898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:02.190107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 116/231] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:02.197975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:02.297646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:02.353920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39c9e-89a1-4a9e-9596-f875f3a1683e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:02.394246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:02.394985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.395267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.395546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] PATH_INFO: `/v3/users/22dd60f795a745eba0cbc0d21264ef67` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.396869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd60f795a745eba0cbc0d21264ef67)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:02.398401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:02.400536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 116/232] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:02 2022] GET /identity/v3/users/22dd60f795a745eba0cbc0d21264ef67 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:02.409034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:02.538363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:02.566763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a430f-bb61-4547-8282-295304783b5e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:02.602167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ce8cd-def4-45c9-a0ce-76031291e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:02.602817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ce8cd-def4-45c9-a0ce-76031291e698 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.603097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ce8cd-def4-45c9-a0ce-76031291e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.603370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ce8cd-def4-45c9-a0ce-76031291e698 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.604544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ce8cd-def4-45c9-a0ce-76031291e698 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:02.606379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ce8cd-def4-45c9-a0ce-76031291e698 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:02.609085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 117/233] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:02 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:02.614805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:02.720388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d4ed1-c8cf-47e5-8eca-fb953eceb2d6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:02.744610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:02.757001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db364a-2a03-4745-9ef4-dc079ccc412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:02.757886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db364a-2a03-4745-9ef4-dc079ccc412e None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.758231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db364a-2a03-4745-9ef4-dc079ccc412e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.758663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db364a-2a03-4745-9ef4-dc079ccc412e None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/22dd60f795a745eba0cbc0d21264ef67/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.761225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db364a-2a03-4745-9ef4-dc079ccc412e None admin] RBAC: Authorizing `identity:create_grant(project_id=9276e465f98d46f2afdff2ecf1dbad50, user_id=22dd60f795a745eba0cbc0d21264ef67, role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:02.762698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db364a-2a03-4745-9ef4-dc079ccc412e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:02.791118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 117/234] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:02 2022] PUT /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/22dd60f795a745eba0cbc0d21264ef67/roles/73a9432602da4fa9aed56acc5eae9592 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:02.819848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cc67a-a201-4331-bbe9-eeedfc03c81d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.820034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cc67a-a201-4331-bbe9-eeedfc03c81d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.820310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cc67a-a201-4331-bbe9-eeedfc03c81d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.821847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 118/235] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:02.827863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.828163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.828426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.858592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:02.859818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:02.932487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c201-fd05-41e1-aa69-48a0ef11f2cf None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.932812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c201-fd05-41e1-aa69-48a0ef11f2cf None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.933057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c201-fd05-41e1-aa69-48a0ef11f2cf None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.934896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 119/236] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:02.941729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:02.942048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:02.942289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:02.945356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 118/237] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:02.967383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:02.968912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:02.994497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:03.052812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 120/238] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:03.082377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:03.155139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:03.183214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0bb6e-1e28-4f06-8950-c9db63f9a12a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:03.198602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ed85d-3789-4986-8ed6-0deb022b81fa None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:03.211653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:03.240220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:03.240911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:03.241196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:03.241469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:03.253321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:03.258667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:03.259548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:03.260510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 121/239] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:03.266789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:03.267562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:03.267938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:03.268315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:03.269587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:03.269763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:03.271228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:03.273205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 119/240] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:03.278437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:03.470081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6375ab-eab6-418f-82ad-c39632281c12 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:03.478541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6d80-def8-4d37-b023-dfda8b748111 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:03.521857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:03.538752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:03.539796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:03.540288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:03.540760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:03.541693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:03.543339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:03.562238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:03.562884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:03.563164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:03.563514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:03.564152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:03.564462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:03.565892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:03.568286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 120/241] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:03 2022] POST /identity/v3/users => generated 293 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:03.587631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 122/242] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:03.594132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:03.663027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:03.765501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1fe7f-767d-4ff1-899d-7d201fcb3797 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:03.818878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:03.819892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:03.820376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:03.820907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] PATH_INFO: `/v3/users/8fb73a5cdf504678bf463ba088cd1f4d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:03.836210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] RBAC: Authorizing `identity:get_user(user_id=8fb73a5cdf504678bf463ba088cd1f4d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:03.838009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:03.840359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 121/243] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:03 2022] GET /identity/v3/users/8fb73a5cdf504678bf463ba088cd1f4d => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:03.849975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:03.966964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99c412-1813-4f61-80e5-b86a12f5c273 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:04.016620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:04.017222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.017507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.017784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.087625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:04.110080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:04.111565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:04.229835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 123/244] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:04.236090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:04.343988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:04.353237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686a44-d1e2-4df0-aef1-c9ff885d5d1f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:04.392328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeef1e-e1b9-4d91-852a-a1b19e53a5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:04.393013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeef1e-e1b9-4d91-852a-a1b19e53a5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.393294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeef1e-e1b9-4d91-852a-a1b19e53a5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.393570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeef1e-e1b9-4d91-852a-a1b19e53a5c7 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.394762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeef1e-e1b9-4d91-852a-a1b19e53a5c7 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:04.396213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeeef1e-e1b9-4d91-852a-a1b19e53a5c7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:04.398040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 122/245] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:04 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:04.404135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:04.466369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccec29-e324-4d54-b72d-519d254fde60 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.466707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccec29-e324-4d54-b72d-519d254fde60 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.466969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccec29-e324-4d54-b72d-519d254fde60 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.469065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 123/246] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:04.478673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d753c-392f-4b45-8858-66c761b1c879 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.478969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d753c-392f-4b45-8858-66c761b1c879 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.479342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d753c-392f-4b45-8858-66c761b1c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.502055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-881d753c-392f-4b45-8858-66c761b1c879 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:04.502968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:04.504460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-881d753c-392f-4b45-8858-66c761b1c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:04.529082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14458edd-1737-414c-98e3-8b863d2d2fd6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:04.573648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:04.574398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.574688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.574998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.575873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] RBAC: Adding query filter params (role.id=cec2e3395ae24dacaaeffb6b77cfc409, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=8fb73a5cdf504678bf463ba088cd1f4d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:04.576227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:04.578841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:04.594072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 124/247] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:04 2022] GET /identity/v3/role_assignments?user.id=8fb73a5cdf504678bf463ba088cd1f4d&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=cec2e3395ae24dacaaeffb6b77cfc409 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:04.603870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 124/248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:04.645179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:04.679637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaab25-bb1a-4e0f-b630-e8c25604f6b4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.679963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaab25-bb1a-4e0f-b630-e8c25604f6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.680207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaab25-bb1a-4e0f-b630-e8c25604f6b4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.681956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 125/249] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:04.689357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.689656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.689913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.726133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:04.727367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:04.838876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84f486-d974-4164-8c3d-7f9efc5bab0a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:04.910663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 126/250] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:04.913481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:04.914463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:04.914982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:04.915452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:04.927371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:04.932968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:04.933995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:04.934795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:04.937544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 125/251] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:04.943606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:04.970292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:04.982272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:05.001204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:05.136889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020919-0a45-436e-a428-7558b609fc9f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:05.213494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38e74-70a3-4738-bbc5-7aa20207ab2f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:05.229089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:05.230077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.230828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.231302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.232266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:05.232800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:05.234421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:05.259639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 127/252] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:05.265699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:05.317754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:05.318818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.319306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.320814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.341762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:05.349612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:05.350537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:05.351357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:05.360424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 126/253] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:05.365077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:05.446636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:05.481259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efdd4e-572d-4810-b912-1f5eacb209d6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:05.530983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:05.608991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6889f-6de3-41b6-83c0-2ca1559544fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:05.610065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6889f-6de3-41b6-83c0-2ca1559544fb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.610357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6889f-6de3-41b6-83c0-2ca1559544fb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.610725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6889f-6de3-41b6-83c0-2ca1559544fb None admin] PATH_INFO: `/v3/users/8322396336c7442c924ab450038169b0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.612136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6889f-6de3-41b6-83c0-2ca1559544fb None admin] RBAC: Authorizing `identity:get_user(user_id=8322396336c7442c924ab450038169b0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:05.614291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6889f-6de3-41b6-83c0-2ca1559544fb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:05.616645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 128/254] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:05 2022] GET /identity/v3/users/8322396336c7442c924ab450038169b0 => generated 297 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:05.622950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6481-8606-46b5-86fd-106bfa9ac1c5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:05.628532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea161-9b69-4d46-8684-d17b0d3d40b2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.628875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea161-9b69-4d46-8684-d17b0d3d40b2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.629122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea161-9b69-4d46-8684-d17b0d3d40b2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.630613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 129/255] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:05.632727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ea161-9b69-4d46-8684-d17b0d3d40b2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:05.722228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:05.722874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.723160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.723440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.724188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:05.724499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:05.726003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce81f58-9e78-4a92-88b1-880a61e3ed85 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:05.740131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 127/256] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:05.742419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.742711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.742991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.784851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:05.786640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:05.883586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ea161-9b69-4d46-8684-d17b0d3d40b2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:05.910595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 128/257] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:05.914186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:05.954633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:05.955348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:05.955632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:05.955909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:05.960016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:05.961512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:05.963612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 130/258] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:05 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:05.964517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:05.988991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:06.078474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbffcb-e752-4cfb-9740-df2ee4936348 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:06.114581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:06.122646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:06.126016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.126310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.126591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.150527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:06.163609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:06.164560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:06.165405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:06.166500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 131/259] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:06.168413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:06.196211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44409c9-dd65-4e2e-9a04-6488855ea332 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:06.238513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:06.239178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.239453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.239735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] PATH_INFO: `/v3/users/22dd60f795a745eba0cbc0d21264ef67` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.240992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd60f795a745eba0cbc0d21264ef67)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:06.242802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:06.244475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 129/260] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:05 2022] GET /identity/v3/users/22dd60f795a745eba0cbc0d21264ef67 => generated 283 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:06.245373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:06.357347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0625f2-9c2d-46f4-8795-0855c25aa7b0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:06.391102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:06.398869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:06.399513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.399864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.400147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.400960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:06.401812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:06.403323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:06.413246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 130/261] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:06.414707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:06.454707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:06.526169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6d0a6-f901-40c3-93da-cd65e746e1fe None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:06.531366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81d6a-8ce9-4181-b45b-c2c91a7f1341 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:06.565269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e87c2-89dc-4363-a6a3-b44a61972b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:06.566058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e87c2-89dc-4363-a6a3-b44a61972b54 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.566481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e87c2-89dc-4363-a6a3-b44a61972b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.566853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e87c2-89dc-4363-a6a3-b44a61972b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.633467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:06.638137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:06.639393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.639676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.639953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/8322396336c7442c924ab450038169b0/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.642007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] RBAC: Authorizing `identity:create_grant(project_id=9276e465f98d46f2afdff2ecf1dbad50, user_id=8322396336c7442c924ab450038169b0, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:06.643485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:06.644077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e87c2-89dc-4363-a6a3-b44a61972b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:06.650942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e87c2-89dc-4363-a6a3-b44a61972b54 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:06.677276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 132/262] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:06 2022] PUT /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/8322396336c7442c924ab450038169b0/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:06.678391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:06.846107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 131/263] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:06.848012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df976b-5f96-4180-a013-1679682d1d89 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.850495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df976b-5f96-4180-a013-1679682d1d89 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.851110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df976b-5f96-4180-a013-1679682d1d89 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.854195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 132/264] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:06.855678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df976b-5f96-4180-a013-1679682d1d89 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:06.903961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8c3f6-16a3-4e40-ac78-61b55b2f377d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:06.966027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c21eaf-0aa4-4e81-a660-a9a0735cb06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:06.966758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21eaf-0aa4-4e81-a660-a9a0735cb06b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.967005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21eaf-0aa4-4e81-a660-a9a0735cb06b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.967284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c21eaf-0aa4-4e81-a660-a9a0735cb06b None admin] PATH_INFO: `/v3/users/22dd60f795a745eba0cbc0d21264ef67` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.968577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c21eaf-0aa4-4e81-a660-a9a0735cb06b None admin] RBAC: Authorizing `identity:get_user(user_id=22dd60f795a745eba0cbc0d21264ef67)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:06.970100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c21eaf-0aa4-4e81-a660-a9a0735cb06b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:06.971739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 133/265] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:06 2022] GET /identity/v3/users/22dd60f795a745eba0cbc0d21264ef67 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:06.973072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:06.973357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:06.973635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:06.993892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:06.995135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:06.996241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:06.997332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.006951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df976b-5f96-4180-a013-1679682d1d89 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.050145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.051068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.051514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.051926 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.053390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.055054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.056970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 133/266] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:06 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:07.057898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.074851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 134/267] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:07.075895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.166658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93118c1-05f0-44b0-a6fd-fdd52a5b3554 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.192268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a88a70-323d-4590-a9b2-b3fb4e145fe4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.204010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e13d5f-8865-4e8e-b4b4-ca235e7bb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.204916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e13d5f-8865-4e8e-b4b4-ca235e7bb513 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.205405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e13d5f-8865-4e8e-b4b4-ca235e7bb513 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.205887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e13d5f-8865-4e8e-b4b4-ca235e7bb513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.229394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.230037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.230322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.230863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.231672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=22dd60f795a745eba0cbc0d21264ef67) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:07.231984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.234125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8f731-5b36-4c38-8f98-c18ea42414a4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.240417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.241693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 135/268] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/role_assignments?user.id=22dd60f795a745eba0cbc0d21264ef67&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:07.243243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b78af-0077-4ae7-be21-3c89c6a77da8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.243683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b78af-0077-4ae7-be21-3c89c6a77da8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.244373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b78af-0077-4ae7-be21-3c89c6a77da8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.246049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 136/269] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:07.247057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b78af-0077-4ae7-be21-3c89c6a77da8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.253235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.290033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e13d5f-8865-4e8e-b4b4-ca235e7bb513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.292436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e13d5f-8865-4e8e-b4b4-ca235e7bb513 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.367293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b78af-0077-4ae7-be21-3c89c6a77da8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.402841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:07.405255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae022-5366-4f23-a376-f25c8e6ec830 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.405640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae022-5366-4f23-a376-f25c8e6ec830 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.406038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bae022-5366-4f23-a376-f25c8e6ec830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.407518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.408459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.409016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.409516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.426761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-70bae022-5366-4f23-a376-f25c8e6ec830 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:07.428049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-70bae022-5366-4f23-a376-f25c8e6ec830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:07.432104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:07.438033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:07.439195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:07.440201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:07.442714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 137/271] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:07.443877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.494211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.507614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 135/272] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:07.509017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc264-921f-48ad-aa5d-79dc133c57bc None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.509302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc264-921f-48ad-aa5d-79dc133c57bc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.509578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc264-921f-48ad-aa5d-79dc133c57bc None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.510859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 136/273] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:07.511773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dc264-921f-48ad-aa5d-79dc133c57bc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.524798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.571940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a2b9-a523-4589-9abc-3c09e73e3c5e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.618625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637b0e1-e5ee-4851-b123-375bf0df405b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.619288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b0e1-e5ee-4851-b123-375bf0df405b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.619580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b0e1-e5ee-4851-b123-375bf0df405b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.620304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637b0e1-e5ee-4851-b123-375bf0df405b None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.621508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b0e1-e5ee-4851-b123-375bf0df405b None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.623651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637b0e1-e5ee-4851-b123-375bf0df405b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.629077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 138/274] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:07.630423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.630802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.631172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.645834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dc264-921f-48ad-aa5d-79dc133c57bc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.650381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:07.651661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:07.688101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.688642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.688951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.689226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.690041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:07.690248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.691672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.701654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 137/275] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:07.705817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.738626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 139/276] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:07.739599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.780952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.833641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:07.836730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30373fd-cabb-4d1c-a7b2-101b5f0a7005 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.889898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.890540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.890819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.891135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.892224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.893707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.895470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 138/277] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:07.896137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:07.915588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d22c17-bca5-4add-81fd-2c81135dccf5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:07.959005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:07.959853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:07.960013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:07.960265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:07.961089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] RBAC: Adding query filter params (role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=22dd60f795a745eba0cbc0d21264ef67) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:07.961396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:07.962829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:07.969924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 140/278] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/role_assignments?user.id=22dd60f795a745eba0cbc0d21264ef67&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:07.978227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:08.035443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26502ac1-a897-4c12-a682-4ac8782886e2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.061730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:08.083869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.085229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.085786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.086211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] PATH_INFO: `/v3/users/12cbe476033d47d68bcbd015409ae477` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.106240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] RBAC: Authorizing `identity:get_user(user_id=12cbe476033d47d68bcbd015409ae477)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:08.108607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:08.111082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 139/279] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/users/12cbe476033d47d68bcbd015409ae477 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:08.112230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:08.114232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5648f-50c1-4015-bd5b-9e4802ee5bca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.158348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:08.175903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.176569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.176884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.177157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.191748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:08.197732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:08.198656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:08.199483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 141/280] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:08.200128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:08.256543 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f975e8-be71-4f10-8d9e-093af5745a09 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.305640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.306717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.307214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.307714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.308885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:08.312228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:08.335801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93330a65-e503-401a-b06d-3605025f0ce6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.341859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 140/281] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:08 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:08.342484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:08.387240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:08.388357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.390177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.391304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.392402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.393814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, user.id=12cbe476033d47d68bcbd015409ae477, scope.system=all) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:08.394451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:08.396413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:08.403894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 142/282] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 10:12:08 2022] GET /identity/v3/role_assignments?user.id=12cbe476033d47d68bcbd015409ae477&scope.system=all&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:08.485440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8fd69-0031-4b60-9dc3-bf9c39a09d66 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.528775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.529413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.529694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.529968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.530706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:08.531015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:08.532510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:08.542359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 141/283] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:08.548869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:08.617619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:08.678387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4112a-780f-4314-a3b3-e3dfb57be9af None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.716639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.717322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.717607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.717878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] PATH_INFO: `/v3/users/8fb73a5cdf504678bf463ba088cd1f4d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.719088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb73a5cdf504678bf463ba088cd1f4d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:08.720530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:08.722496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:08 2022] GET /identity/v3/users/8fb73a5cdf504678bf463ba088cd1f4d => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:08.728517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:08.845047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:08.853307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167942e4-3f93-4b65-85b0-278095f9e2e1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:08.897253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6949bc-dc77-42c9-90ec-0367bc8c4a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:08.897982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6949bc-dc77-42c9-90ec-0367bc8c4a2d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:08.898346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6949bc-dc77-42c9-90ec-0367bc8c4a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:08.898813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6949bc-dc77-42c9-90ec-0367bc8c4a2d None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:08.900201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6949bc-dc77-42c9-90ec-0367bc8c4a2d None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:08.901828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6949bc-dc77-42c9-90ec-0367bc8c4a2d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:08.904763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 142/285] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:08 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:08.910610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:09.038693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01103-1afb-4821-80a5-dbf155b50f14 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:09.039038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01103-1afb-4821-80a5-dbf155b50f14 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:09.039254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea01103-1afb-4821-80a5-dbf155b50f14 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:09.040758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 143/286] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:09.047377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:09.047963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:09.048714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:09.064712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92710b-ea35-4b89-b1f8-d6ec7f8fce66 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:09.085887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:09.087515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:09.103736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:09.141654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:09.142757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:09.143238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:09.143721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/8fb73a5cdf504678bf463ba088cd1f4d/roles/cec2e3395ae24dacaaeffb6b77cfc409` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:09.147339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] RBAC: Authorizing `identity:create_grant(project_id=9276e465f98d46f2afdff2ecf1dbad50, user_id=8fb73a5cdf504678bf463ba088cd1f4d, role_id=cec2e3395ae24dacaaeffb6b77cfc409)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:09.150533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:09.180087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 144/287] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:08 2022] PUT /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/users/8fb73a5cdf504678bf463ba088cd1f4d/roles/cec2e3395ae24dacaaeffb6b77cfc409 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:09.215522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 144/288] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:09.254816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:09.395045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7025eac-a6c2-4dab-9927-9a6b3c785134 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:09.432773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:09.433818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:09.434298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:09.434781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:09.445754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:09.451948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:09.452818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:09.453643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:09.456334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 145/289] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:09.461811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:09.586956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:09.594194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167b6c-4d21-4eaa-8a0a-0824e3b72250 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:09.643214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:09.643868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:09.644147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:09.644419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:09.645269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:09.645517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:09.646975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:09.661501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 145/290] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:09.667234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:09.713252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:09.785842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd09c59-2c69-4f21-91ce-24420a3001f3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:09.820823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:09.821496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:09.821774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:09.822044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] PATH_INFO: `/v3/users/8322396336c7442c924ab450038169b0` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:09.823227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] RBAC: Authorizing `identity:get_user(user_id=8322396336c7442c924ab450038169b0)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:09.824689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:09.827005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 146/291] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:09 2022] GET /identity/v3/users/8322396336c7442c924ab450038169b0 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:09.832748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:09.956097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21361d19-c84c-4f24-bd85-ccd3887277fc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:10.031911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:10.032959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:10.033435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:10.033912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:10.067376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:10.121138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:10.123490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:10.254290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 146/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:10.259867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:10.398559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cec9b-c2b9-457b-a54a-7f8ce8643d08 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:10.400924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:10.451601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00c6d2-e455-423e-a032-13c1e644e457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:10.451601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c6d2-e455-423e-a032-13c1e644e457 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:10.451601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c6d2-e455-423e-a032-13c1e644e457 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:10.451919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00c6d2-e455-423e-a032-13c1e644e457 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:10.452971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c6d2-e455-423e-a032-13c1e644e457 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:10.454433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00c6d2-e455-423e-a032-13c1e644e457 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:10.456121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 147/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:10 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:10.462154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:10.528669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:10.574163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d8cc1-07f6-4c82-9e34-2e13f8d16cad None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:10.609410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:10.610031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:10.610312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:10.610582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:10.611433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=8322396336c7442c924ab450038169b0) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:10.611740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:10.613263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f4f91-b961-4531-ba10-601f6ded72d9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:10.619577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 147/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:10 2022] GET /identity/v3/role_assignments?user.id=8322396336c7442c924ab450038169b0&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:10.753623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7ad5-a16d-4e40-a93b-8c990bd4858b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:10.754080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7ad5-a16d-4e40-a93b-8c990bd4858b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:10.754460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7ad5-a16d-4e40-a93b-8c990bd4858b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:10.756302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 148/295] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:10.761802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:10.762113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:10.762368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:10.789669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:10.790837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:10.887661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:10.910854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f7ad5-a16d-4e40-a93b-8c990bd4858b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.049511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f7ad5-a16d-4e40-a93b-8c990bd4858b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.085376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27c43b-9b88-4caf-b87c-e7e6056b3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.086372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27c43b-9b88-4caf-b87c-e7e6056b3f17 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.086864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27c43b-9b88-4caf-b87c-e7e6056b3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.087337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27c43b-9b88-4caf-b87c-e7e6056b3f17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.099737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27c43b-9b88-4caf-b87c-e7e6056b3f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3e27c43b-9b88-4caf-b87c-e7e6056b3f17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:11.105891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:11.106821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:11.107686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:11.111384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 149/297] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:11.120032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.175405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:11.219199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956ec4-f798-414d-b5c1-ce8c6c265cd8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.219507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956ec4-f798-414d-b5c1-ce8c6c265cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.219785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01956ec4-f798-414d-b5c1-ce8c6c265cd8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.221286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 150/298] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:11.226370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.226712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.227122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.230905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd945-5fc9-4b41-a763-3a45d642c4f6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.246064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:11.247383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:11.270241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.271114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.271540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.271979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.273001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:11.273451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:11.274987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:11.278849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:11.286319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 149/299] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:11.292159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.341176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 151/300] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:11.364797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.421061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4321-8f23-4fa9-be35-13d4d2016965 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.434854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:11.459539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b11e7-4591-48a7-8ad0-957ab5aee5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.460206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b11e7-4591-48a7-8ad0-957ab5aee5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.460486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b11e7-4591-48a7-8ad0-957ab5aee5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.460761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b11e7-4591-48a7-8ad0-957ab5aee5e5 None admin] PATH_INFO: `/v3/users/12cbe476033d47d68bcbd015409ae477` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.462002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b11e7-4591-48a7-8ad0-957ab5aee5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=12cbe476033d47d68bcbd015409ae477)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:11.463459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b11e7-4591-48a7-8ad0-957ab5aee5e5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:11.470213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 150/301] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:11 2022] GET /identity/v3/users/12cbe476033d47d68bcbd015409ae477 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:11.470213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ec5b-d0cf-4024-afed-0a1f38fd6365 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.470213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ec5b-d0cf-4024-afed-0a1f38fd6365 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.470213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7ec5b-d0cf-4024-afed-0a1f38fd6365 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.470213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 151/302] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:11.472267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7ec5b-d0cf-4024-afed-0a1f38fd6365 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.486986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e27f3-a9ef-434f-9803-98d48c2aa557 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.523041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f9715-8afe-4da6-b2ea-648ab152cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.523691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9715-8afe-4da6-b2ea-648ab152cf16 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.523971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9715-8afe-4da6-b2ea-648ab152cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.524259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f9715-8afe-4da6-b2ea-648ab152cf16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.535539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f9715-8afe-4da6-b2ea-648ab152cf16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2d7f9715-8afe-4da6-b2ea-648ab152cf16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:11.540524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:11.541482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:11.542279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:11.546484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 152/303] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:11.548048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.548048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.548336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.567018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:11.568252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:11.587428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:11.617410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7ec5b-d0cf-4024-afed-0a1f38fd6365 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.645909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 153/304] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:11.646760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.665662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.666607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.667009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.667381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] PATH_INFO: `/v3/system/users/12cbe476033d47d68bcbd015409ae477/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.670081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12cbe476033d47d68bcbd015409ae477, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:11.671653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:11.688882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 152/305] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jul 26 10:12:11 2022] PUT /identity/v3/system/users/12cbe476033d47d68bcbd015409ae477/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:11.688882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.771046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:11.799037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9a7d5-c84e-41c2-9177-a7bfb5adf766 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.837779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.838429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.838736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.838999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.839740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:11.840042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:11.841524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8d4fb-3cd5-4227-8f51-cf647151ddb4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:11.851602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 154/306] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:11.852615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb514020-c748-4b80-b3d7-45d67cccf66c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.852921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb514020-c748-4b80-b3d7-45d67cccf66c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.853197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb514020-c748-4b80-b3d7-45d67cccf66c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.854574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 155/307] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:11.858117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb514020-c748-4b80-b3d7-45d67cccf66c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:11.866310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965da6-4569-4357-bc5a-4c11a5e7effd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:11.876366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:11.906735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5d83c-146a-4fa0-bc15-cacaf93e2228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:11.907504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d83c-146a-4fa0-bc15-cacaf93e2228 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.907866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d83c-146a-4fa0-bc15-cacaf93e2228 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.908145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d83c-146a-4fa0-bc15-cacaf93e2228 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.909350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5d83c-146a-4fa0-bc15-cacaf93e2228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:11.910828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5d83c-146a-4fa0-bc15-cacaf93e2228 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:11.912614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 153/308] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:11.918341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:11.918990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:11.920130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:11.939820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:11.941063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:11.979175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb514020-c748-4b80-b3d7-45d67cccf66c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.016516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 154/309] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:12.017178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.017899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.018186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.018454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] PATH_INFO: `/v3/users/3d06e96cb34b419c84ca67a150907a0e` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.022650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:12.037049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] RBAC: Authorizing `identity:get_user(user_id=3d06e96cb34b419c84ca67a150907a0e)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:12.038573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:12.040887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 156/310] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:11 2022] GET /identity/v3/users/3d06e96cb34b419c84ca67a150907a0e => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:12.046481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:12.084985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:12.133333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:12.163097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38830477-2384-470b-ad45-9956f8dd1ec8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.173967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dd923-ead4-4cc5-8e1f-b74cef41c810 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.205469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.205813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.205943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.206317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] PATH_INFO: `/v3/groups` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.206912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:12.208872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:12.224631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.225357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.225641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.225915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.233253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 155/311] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jul 26 10:12:12 2022] POST /identity/v3/groups => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:12.233253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:12.254545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:12.262123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:12.263098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:12.264467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:12.270286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 157/312] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:12.271260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:12.365813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4359-f18f-4d4a-bbcd-c070843bc978 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.367939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:12.410164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.410718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.410996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.411366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.412175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] RBAC: Adding query filter params (role.id=cec2e3395ae24dacaaeffb6b77cfc409, user.id=3d06e96cb34b419c84ca67a150907a0e, scope.system=all) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:12.412482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:12.413994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:12.420411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789da59-14b6-4256-be6f-8dcb2c8071fe None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.420940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 156/313] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 10:12:12 2022] GET /identity/v3/role_assignments?user.id=3d06e96cb34b419c84ca67a150907a0e&scope.system=all&role.id=cec2e3395ae24dacaaeffb6b77cfc409 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:12.456986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:12.462892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.463536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.463823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.464161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.464948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:12.465264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:12.466764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:12.477340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 158/314] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:12.483611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:12.602816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8c959-4c62-438d-8f83-d762b0fd18f2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.644041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.644691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.644999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.645270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] PATH_INFO: `/v3/users/8fb73a5cdf504678bf463ba088cd1f4d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.646450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] RBAC: Authorizing `identity:get_user(user_id=8fb73a5cdf504678bf463ba088cd1f4d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:12.647899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:12.649883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 157/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:12 2022] GET /identity/v3/users/8fb73a5cdf504678bf463ba088cd1f4d => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:12.655050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:12.761984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194745-c196-488a-ae2a-bb22a3c52f81 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:12.799887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:12.800526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:12.800815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:12.801106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:12.872249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:12.881094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:12.882880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:13.004166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 159/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:13.009382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:13.044147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:13.113420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b406fb-f524-4e37-b23e-d1204a22f590 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:13.149203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9618838f-d421-49e5-b5b2-b09c99f03c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:13.149851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618838f-d421-49e5-b5b2-b09c99f03c87 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:13.150127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618838f-d421-49e5-b5b2-b09c99f03c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:13.150396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9618838f-d421-49e5-b5b2-b09c99f03c87 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:13.151559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618838f-d421-49e5-b5b2-b09c99f03c87 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:13.153050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9618838f-d421-49e5-b5b2-b09c99f03c87 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:13.155590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 158/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:13 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:13.161222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:13.254825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:13.261395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f9833-5e6e-4f30-a317-fed82aa3197e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:13.303344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0706252-f139-4953-806e-580691b53b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:13.304308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0706252-f139-4953-806e-580691b53b29 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:13.304807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0706252-f139-4953-806e-580691b53b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:13.305354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0706252-f139-4953-806e-580691b53b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:13.306401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0706252-f139-4953-806e-580691b53b29 None admin] RBAC: Adding query filter params (role.id=cec2e3395ae24dacaaeffb6b77cfc409, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50, user.id=8fb73a5cdf504678bf463ba088cd1f4d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:13.306950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0706252-f139-4953-806e-580691b53b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:13.308683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0706252-f139-4953-806e-580691b53b29 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:13.315415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 160/318] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:13 2022] GET /identity/v3/role_assignments?user.id=8fb73a5cdf504678bf463ba088cd1f4d&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=cec2e3395ae24dacaaeffb6b77cfc409 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:13.803963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264557-2671-44c9-a21b-145cfb38b0d8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:13.804246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264557-2671-44c9-a21b-145cfb38b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:13.804701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3264557-2671-44c9-a21b-145cfb38b0d8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:13.806222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 159/319] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:13.811243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:13.811719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:13.811800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:13.829783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:13.830984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:13.900872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 161/320] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:13.924173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264557-2671-44c9-a21b-145cfb38b0d8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.033262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3264557-2671-44c9-a21b-145cfb38b0d8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.034927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:14.068682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.069267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.069544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.069808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.080868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:14.085826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:14.086768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:14.087680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 160/321] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:14.095374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.188066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:14.201959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f70bdd-e48f-4396-8e34-5fbe6c9fbc2c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.244715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.245382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.245666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.245943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.246665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:14.246967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:14.248959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344553e-5380-4a2e-97c8-977cd261b1fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:14.257898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 162/322] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:14.263418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.375162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cf283-4a65-4073-a08f-38944c8cd693 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.410934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.411584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.411858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.412133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] PATH_INFO: `/v3/users/12cbe476033d47d68bcbd015409ae477` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.413385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] RBAC: Authorizing `identity:get_user(user_id=12cbe476033d47d68bcbd015409ae477)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:14.414848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:14.416328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c33fa9-e292-4ddb-948a-c57978c2be94 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.421560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c33fa9-e292-4ddb-948a-c57978c2be94 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.421727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 161/323] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:14 2022] GET /identity/v3/users/12cbe476033d47d68bcbd015409ae477 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:14.421829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c33fa9-e292-4ddb-948a-c57978c2be94 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.421829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 163/324] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:14.423930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.424172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265ccd-bc14-4af0-a8b8-b1e518ebeabd None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.424461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265ccd-bc14-4af0-a8b8-b1e518ebeabd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.424737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d265ccd-bc14-4af0-a8b8-b1e518ebeabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.442991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5d265ccd-bc14-4af0-a8b8-b1e518ebeabd None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:14.445110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d265ccd-bc14-4af0-a8b8-b1e518ebeabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:14.463229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:14.534062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 164/325] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:14.535361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4031-ab29-498c-a194-a48fe6fa0d3f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.535650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4031-ab29-498c-a194-a48fe6fa0d3f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.535931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b4031-ab29-498c-a194-a48fe6fa0d3f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.537334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 165/326] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:14.543077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.543361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.543627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.550834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67513ca2-09fe-4a60-a726-a54ce29886f8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.563027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:14.564255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:14.587809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.588451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.588859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.589035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.589853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] RBAC: Adding query filter params (role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, user.id=12cbe476033d47d68bcbd015409ae477, scope.system=all) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:14.590163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:14.592165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:14.605203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 162/327] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 10:12:14 2022] GET /identity/v3/role_assignments?user.id=12cbe476033d47d68bcbd015409ae477&scope.system=all&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:14.606753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.644648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 166/328] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:14.669120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.681715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:14.721061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:14.737951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b834da5-f9f4-4f40-9705-6eeae1e847db None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.780569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.781278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.781553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.781877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.783043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:14.784488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:14.786365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 163/329] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:14.786510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346825e-2065-4933-9118-6f9441ac27ae None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.791687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.829150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.829807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.830087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.830361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.842959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:14.847978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:14.849103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:14.849928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 167/330] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:14.854815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:14.914535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d233e-9cda-4a45-bff2-ee3e830a56de None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.924474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:14.948162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.948785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.949114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.949389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] PATH_INFO: `/v3/groups` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.950051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:14.952022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:14.955822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0853979-a572-4bdd-89a3-14b506912b36 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:14.968451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 164/331] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Jul 26 10:12:14 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:12:14.997691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:14.998329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:14.998609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:14.998880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:14.999625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:14.999928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:15.001392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:15.010699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 168/332] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:15.017127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:15.039668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:15.130415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73d0a1-05bc-4a06-8231-e68b7548aabc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:15.165392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083a640-45e2-4d50-b38a-fc048c3d730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:15.165972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083a640-45e2-4d50-b38a-fc048c3d730f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:15.166252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083a640-45e2-4d50-b38a-fc048c3d730f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:15.166531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083a640-45e2-4d50-b38a-fc048c3d730f None admin] PATH_INFO: `/v3/users/3d06e96cb34b419c84ca67a150907a0e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:15.167705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083a640-45e2-4d50-b38a-fc048c3d730f None admin] RBAC: Authorizing `identity:get_user(user_id=3d06e96cb34b419c84ca67a150907a0e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:15.169187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083a640-45e2-4d50-b38a-fc048c3d730f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:15.170789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 165/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:15 2022] GET /identity/v3/users/3d06e96cb34b419c84ca67a150907a0e => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:15.176661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:15.283546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a689f-dd8d-41f7-a130-d2e5cbb91691 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:15.314315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:15.320942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa6f24-7f48-4581-a159-5bbcc5d6333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:15.321700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6f24-7f48-4581-a159-5bbcc5d6333b None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:15.321887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6f24-7f48-4581-a159-5bbcc5d6333b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:15.322165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa6f24-7f48-4581-a159-5bbcc5d6333b None admin] PATH_INFO: `/v3/system/users/3d06e96cb34b419c84ca67a150907a0e/roles/cec2e3395ae24dacaaeffb6b77cfc409` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:15.323659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6f24-7f48-4581-a159-5bbcc5d6333b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d06e96cb34b419c84ca67a150907a0e, role_id=cec2e3395ae24dacaaeffb6b77cfc409)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:15.325400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa6f24-7f48-4581-a159-5bbcc5d6333b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:15.336293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 169/334] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Jul 26 10:12:15 2022] PUT /identity/v3/system/users/3d06e96cb34b419c84ca67a150907a0e/roles/cec2e3395ae24dacaaeffb6b77cfc409 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:17.359607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c6e1-afe2-4a2f-a1a6-955173324070 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.360635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c6e1-afe2-4a2f-a1a6-955173324070 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.361175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6c6e1-afe2-4a2f-a1a6-955173324070 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.362752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 166/335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:17.368570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e16c8-04d6-4e3d-b340-47fe922451a7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.369501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e16c8-04d6-4e3d-b340-47fe922451a7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.369977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e16c8-04d6-4e3d-b340-47fe922451a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.397893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5f8e16c8-04d6-4e3d-b340-47fe922451a7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:17.399443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5f8e16c8-04d6-4e3d-b340-47fe922451a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:17.483150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 170/336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:17.528323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6c6e1-afe2-4a2f-a1a6-955173324070 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:17.635858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:17.659828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6c6e1-afe2-4a2f-a1a6-955173324070 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:17.704867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:17.705917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.706413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.706881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.720774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdbcd8-b11e-4fb7-b960-88dd5d0b9732 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.721733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdbcd8-b11e-4fb7-b960-88dd5d0b9732 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.722495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:17.722773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bdbcd8-b11e-4fb7-b960-88dd5d0b9732 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:17.730730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:17.732573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:17.734180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 167/337] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:17.737763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:17.739097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 171/338] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:17 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:17.744742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.745517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.746207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.798235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:17.801138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:17.872804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc5ec0-c6ff-4ef7-a9ed-df124e6114d5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:17.926383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:17.926936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.927218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.927482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.928234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:17.928544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:17.930026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ad62f-d368-4fc5-8b1a-3789c9aeff92 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:17.948982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 168/339] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:17.950321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc7e50-1cf3-4422-823f-4560414d935c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.950616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc7e50-1cf3-4422-823f-4560414d935c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.951627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc7e50-1cf3-4422-823f-4560414d935c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.952424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 169/340] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:17.958018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:17.958365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:17.958622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:17.980336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:17.988874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:17.990194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:18.043871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 172/341] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:18.045402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.144094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 170/342] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:18.144985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.165552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:18.219449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6f41f-4c12-4aab-ae1c-bddba587e766 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:18.262757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:18.263985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.264413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.264694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.316506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5cb5d-649e-48ed-b843-2ddde822185e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:18.356547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:18.358677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:18.365052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546cbdb-1066-44fc-b00f-e26d97c75aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:18.366976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546cbdb-1066-44fc-b00f-e26d97c75aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.367741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546cbdb-1066-44fc-b00f-e26d97c75aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.368566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546cbdb-1066-44fc-b00f-e26d97c75aa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.376027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:18.393775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546cbdb-1066-44fc-b00f-e26d97c75aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c546cbdb-1066-44fc-b00f-e26d97c75aa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:18.398860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:18.400474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:18.402070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 171/343] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:18.403333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19e88-f93e-4e22-a068-67256c55fc9a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.403333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19e88-f93e-4e22-a068-67256c55fc9a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.403333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db19e88-f93e-4e22-a068-67256c55fc9a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.405747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 172/344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:18.406462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19e88-f93e-4e22-a068-67256c55fc9a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.479074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:18.545537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 173/345] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:18.547348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.566293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db19e88-f93e-4e22-a068-67256c55fc9a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:18.611942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257203f6-57c6-4948-b7c0-e62026c2fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:18.612901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257203f6-57c6-4948-b7c0-e62026c2fb82 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.613570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257203f6-57c6-4948-b7c0-e62026c2fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.614017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257203f6-57c6-4948-b7c0-e62026c2fb82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.630065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257203f6-57c6-4948-b7c0-e62026c2fb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-257203f6-57c6-4948-b7c0-e62026c2fb82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:18.637205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:18.638858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:18.639886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:18.642531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 173/346] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:18.644067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.644513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.644970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.669270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:18.671737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:18.686622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb3022-3461-4ef9-aa54-1eb613645ae2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:18.737642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:18.738280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.738624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.739180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.739791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] RBAC: Adding query filter params (name=member) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:18.740159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:18.741721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:18.748976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:18.752954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 174/347] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:18.754079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.773864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 174/348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:18.775257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.783753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:18.907475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d002b0-685c-49cd-a6f5-064d459bf464 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:18.913352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec38ad1-9f8f-482e-9d45-cb4336bd0f79 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:18.948083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:18.948734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.949082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.949347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.950534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:18.956662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:18.956662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 175/349] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:18.959218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:18.959726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:18.960357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:18.960642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:18.961437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:18.962502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:18.963801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:18.965256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:18.976463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 175/350] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:18.977847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.041861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.079564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.091836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba33e4-d70a-4fb7-8f34-4f270d813d4e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.113158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fed3d-0fd8-420b-ae34-8f0c30cecf05 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.142407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ca02-1d46-45e1-9f6d-b5003beb0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.143161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ca02-1d46-45e1-9f6d-b5003beb0c8f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.143363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ca02-1d46-45e1-9f6d-b5003beb0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.143646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ca02-1d46-45e1-9f6d-b5003beb0c8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.163812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.164471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.164751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.165055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.184306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:19.190222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:19.191133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:19.191917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 176/351] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:19.192570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.244355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70ca02-1d46-45e1-9f6d-b5003beb0c8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:19.246234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70ca02-1d46-45e1-9f6d-b5003beb0c8f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:19.320219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1237e-eefd-4f20-9cce-fc60271d08b0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.330889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.360777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.365799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.365799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.365799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.365799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.372018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:19.374396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:19.376761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 177/352] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:19.377794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.379672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 176/353] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:19.380977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b964-02df-42af-ae9e-06835d830d16 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.381261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b964-02df-42af-ae9e-06835d830d16 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.381531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b964-02df-42af-ae9e-06835d830d16 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.383249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 177/354] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:19.383863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b964-02df-42af-ae9e-06835d830d16 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.521072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208a9c8-fc7a-4273-ac0d-ec04385ae7ef None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.524335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b964-02df-42af-ae9e-06835d830d16 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.567453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477512b8-0ffe-46fe-a46f-23ee3afadac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.568086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477512b8-0ffe-46fe-a46f-23ee3afadac2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.568367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477512b8-0ffe-46fe-a46f-23ee3afadac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.568642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477512b8-0ffe-46fe-a46f-23ee3afadac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.568967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.569608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.569860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.570133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.571025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:19.571278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:19.573235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:19.583738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 178/355] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:19.585243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.617856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.649934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.653652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477512b8-0ffe-46fe-a46f-23ee3afadac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:19.655518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477512b8-0ffe-46fe-a46f-23ee3afadac2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:19.716783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5c629-4ce3-4ab6-a630-ef586a01ecc9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.760142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.760777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.762883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.762883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.763778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=96753d928a2342e69f156ffb28c8de92) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:19.764091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:19.765614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:19.771471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 179/356] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:19.772300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.792126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 178/357] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:19.795150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.795800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.796294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.819487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:19.821268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:19.917177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 179/358] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:19.917679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:19.923161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.927363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939ef57-bab4-4abf-acbd-e29735258c3b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:19.948439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:19.979074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d36fbe-0031-4e82-890c-7c3ffe8b93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:19.979734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d36fbe-0031-4e82-890c-7c3ffe8b93b0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.980012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d36fbe-0031-4e82-890c-7c3ffe8b93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.980287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d36fbe-0031-4e82-890c-7c3ffe8b93b0 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.982319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d36fbe-0031-4e82-890c-7c3ffe8b93b0 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:19.983797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d36fbe-0031-4e82-890c-7c3ffe8b93b0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:19.990233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 180/359] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:19.991672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe68d-dbdf-4f9e-8fc2-56ecf4985b17 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:19.991958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe68d-dbdf-4f9e-8fc2-56ecf4985b17 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:19.992231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfe68d-dbdf-4f9e-8fc2-56ecf4985b17 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:19.995353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 181/360] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:19.996188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe68d-dbdf-4f9e-8fc2-56ecf4985b17 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.061345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92240a-16a1-49f0-9b3d-6190d2b5beaa None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.110801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.111471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.112118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.112118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] PATH_INFO: `/v3/users/3d06e96cb34b419c84ca67a150907a0e` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.114584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] RBAC: Authorizing `identity:get_user(user_id=3d06e96cb34b419c84ca67a150907a0e)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.116193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.118177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 180/361] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/users/3d06e96cb34b419c84ca67a150907a0e => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.118822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.142294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfe68d-dbdf-4f9e-8fc2-56ecf4985b17 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.183885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.184551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.184947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.185750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.186995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.188477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.190294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 182/362] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:19 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.191307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.214629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:20.258380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:20.259774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a160866-7291-435f-a528-e3f0da0d437d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.314289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18c529-4447-4f19-a357-435acf97cb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.315326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c529-4447-4f19-a357-435acf97cb2c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.315769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c529-4447-4f19-a357-435acf97cb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.316559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18c529-4447-4f19-a357-435acf97cb2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.326562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7a897-e63a-4af5-b801-c3e6d76306ca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.332270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18c529-4447-4f19-a357-435acf97cb2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5d18c529-4447-4f19-a357-435acf97cb2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:20.340600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:20.342195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 181/363] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:20.343567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.346177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.346177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.365478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:20.366595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:20.381735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.382772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.383053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.386592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.386592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.387963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.390116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 183/364] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.390917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.463802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 182/365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:20.464813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.524923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e446f-755c-46d0-819b-48a707131513 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.532599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:20.545795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:20.574163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.574798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.575082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.575364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.576241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] RBAC: Adding query filter params (role.id=cec2e3395ae24dacaaeffb6b77cfc409, user.id=3d06e96cb34b419c84ca67a150907a0e, scope.system=all) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:20.576556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.578092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.592398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 184/366] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/role_assignments?user.id=3d06e96cb34b419c84ca67a150907a0e&scope.system=all&role.id=cec2e3395ae24dacaaeffb6b77cfc409 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.593403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.595814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1fc70-f795-4b05-9288-e36f544a6507 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.646892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.647907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.650847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.651768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.654278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.656732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.659821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 183/367] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.661524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.741255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ca74-6f1b-4f52-ab55-2ed601bc12ed None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.789457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.791130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.791766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.792043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.792780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:20.793116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.795053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.809350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 185/368] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.810846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.823357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19f2a0-b6ae-4eff-8a04-ff9b3cfebdbb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:20.856144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:20.867386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:20.868222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:20.869030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:20.869325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:20.869731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:20.870706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:20.871087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:20.873662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:20.880326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 184/369] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:20.881903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:20.971787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51dee7b-39b3-40e4-8bf8-3cc2a814fb92 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.021432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.022502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.022991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.023197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea60de2-8816-4786-afe4-35521196aa07 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.023663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.039606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:21.046346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:21.047283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:21.048080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:21.050810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 186/370] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:21.051962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:21.072417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.073096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.073399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.073649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.074572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=96753d928a2342e69f156ffb28c8de92) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:21.074889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:21.078056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:21.084671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 185/371] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:20 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:21.085496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:21.152913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:21.181252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:21.186184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099e99c-3418-40b2-9e84-646cedcc0203 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.209795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ede4-a784-41cb-84e3-7f9795bde784 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.229374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.229374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.229374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.229374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.276059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.276773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.277090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.277411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.278263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:21.278576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:21.280730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:21.301164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 186/372] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:21.307262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:21.308140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:21.309621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:21.451889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:21.462717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 187/373] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:21.469908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:21.551155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3600fbb-8514-42fe-a851-fb074a7d0f40 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.598012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da08a7-0889-402b-ace0-fea9c5caf2a3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.617000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:21.641869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.642509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.642792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.643069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.669496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.670150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.670432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.670707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.673259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:21.674750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:21.676513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 188/374] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:21.683712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:21.796720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:21.798164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:21.815231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:21.902845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c94c9-19ad-4160-9005-009a9466220c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:21.925986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 187/375] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:12:21.931733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:21.960890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:21.969661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:21.970326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:21.970602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:21.970875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:21.972862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:21.974330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:21.976137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 189/376] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:21.983778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:22.070660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ef9f-2741-434d-9f56-5ab21a0f1f35 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:22.114276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:22.115308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.115780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.116243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] PATH_INFO: `/v3/projects/efd8d0a5798b4c52a018435ee59fbf54` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.118508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] RBAC: Authorizing `identity:get_project(project_id=efd8d0a5798b4c52a018435ee59fbf54)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:22.120632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:22.122776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 188/377] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/projects/efd8d0a5798b4c52a018435ee59fbf54 => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:22.128911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:22.224575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4dd9d-080a-4c90-8deb-16d48e924690 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:22.273230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:22.285153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:22.291319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:22.292080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.292466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.292807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.293750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:22.294067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:22.296606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b0922-f0b2-4aa8-aa86-95731906623c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:22.297441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2e4b9-2073-4dbd-8de1-ab18de6e7da9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:22.302605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 190/378] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:21 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 260 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:22.303922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c729-09f4-4a96-a013-c56c8120c0a0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.304213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c729-09f4-4a96-a013-c56c8120c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.304488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c729-09f4-4a96-a013-c56c8120c0a0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.305809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 191/379] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:22.314397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.314778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.315828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.345967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:22.347862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:22.352920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:22.353611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.353896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.354176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] PATH_INFO: `/v3/groups/00166be2659840f5bd5c25ad48be1453` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.363655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] RBAC: Authorizing `identity:get_group(group_id=00166be2659840f5bd5c25ad48be1453)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:22.366007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:22.368665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 189/380] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:22 2022] GET /identity/v3/groups/00166be2659840f5bd5c25ad48be1453 => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:22.375210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:22.458376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 192/381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:22.497827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:22.574900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2410878-7712-49d5-9294-f5d145b8cb66 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:22.644521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:22.645537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.646039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.646532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.648045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] RBAC: Adding query filter params (group.id=00166be2659840f5bd5c25ad48be1453, role.id=2b446efbd008435f977d0068496eb403, scope.project.id=efd8d0a5798b4c52a018435ee59fbf54) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:22.648833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:22.651329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:22.673990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 190/382] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:22 2022] GET /identity/v3/role_assignments?group.id=00166be2659840f5bd5c25ad48be1453&scope.project.id=efd8d0a5798b4c52a018435ee59fbf54&role.id=2b446efbd008435f977d0068496eb403 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:22.704922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c4309-451c-46e7-923e-4d4af4605601 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:22.737717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:22.755553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:22.756373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.756654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.756949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.772502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:22.781866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:22.782831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:22.783726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 193/383] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:22.790898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:22.815356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:22.928572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bb85e-6cd0-4685-9a0f-595d31f7fdce None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:22.975900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:22.976554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:22.976833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:22.977139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:22.977875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:22.978180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:22.979601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:22.995273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 191/384] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:23.001065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:23.162437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb7d84-09cf-46f1-ae0e-0c5a8a59faf4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:23.217085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:23.221369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.221665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.221945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.223253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:23.224715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:23.226386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 194/385] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:22 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:23.232911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:23.407906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:23.439156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee3640-4d65-4a65-98b0-90ce6e309d3c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:23.494550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaf071-13cc-484a-b09d-2d898c23bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:23.495127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf071-13cc-484a-b09d-2d898c23bd0f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.495408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf071-13cc-484a-b09d-2d898c23bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.495680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaf071-13cc-484a-b09d-2d898c23bd0f None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.497167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaf071-13cc-484a-b09d-2d898c23bd0f None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:23.499162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaf071-13cc-484a-b09d-2d898c23bd0f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:23.501184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 192/386] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:23 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:23.506816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:23.583027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:23.651043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca79dc5-da8f-41fa-a97d-8c7abd0fa397 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:23.694691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de2f7e-0413-4ec1-a8de-1c7c88238c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:23.695393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de2f7e-0413-4ec1-a8de-1c7c88238c66 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.695674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de2f7e-0413-4ec1-a8de-1c7c88238c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.695949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de2f7e-0413-4ec1-a8de-1c7c88238c66 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.697992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de2f7e-0413-4ec1-a8de-1c7c88238c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=96753d928a2342e69f156ffb28c8de92, group_id=6a76acc284aa4dc9ab870b52cf676af6, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:23.699469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de2f7e-0413-4ec1-a8de-1c7c88238c66 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:23.718291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 195/387] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 10:12:23 2022] PUT /identity/v3/projects/96753d928a2342e69f156ffb28c8de92/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:23.811358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c650d12-9890-48b7-bc67-526ddc88c44c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.811876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c650d12-9890-48b7-bc67-526ddc88c44c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.811876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c650d12-9890-48b7-bc67-526ddc88c44c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.813635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 193/388] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:23.820688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.821386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.821865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.850135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:23.851880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:23.887665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc0e66-d8f9-4d08-b6a1-cdc8c95882eb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.888058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc0e66-d8f9-4d08-b6a1-cdc8c95882eb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.888243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc0e66-d8f9-4d08-b6a1-cdc8c95882eb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.890387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 194/389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:23.897398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:23.897748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:23.897963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:23.936676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:23.939651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:23.968731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 196/390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:23.995470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.044129 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 195/391] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:24.060519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.087542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.119619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd52dc-2ca8-424e-8616-61f06a3889f0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.155002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.155449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.155713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.155984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.174285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:24.182017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:24.182934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:24.183750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:24.185831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 197/392] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:24.193424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.238474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.275767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119bcd-4c86-4385-ad5f-4c96fa599c2c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.313986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.314809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.315098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.315367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.328229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:24.336815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:24.339111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:24.341398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 196/393] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:24.347263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.392313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae446b-65a3-467c-ba1d-49015b113a6a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.398415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.459520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.460209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.460489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.460941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.461667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:24.461969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:24.463359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:24.473528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 198/394] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:24.479345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.522685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58168e3-21dd-4a84-9f77-cf697973ec4e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.593547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.594089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.594365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.594634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.595352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:24.595651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:24.597069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:24.598862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.617096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 197/395] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:24.622987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.642210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fecfd-4b05-4167-985b-d56aafbd0286 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.676429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.677107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.677387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.677665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.678825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:24.680268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:24.682192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 199/396] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:24.688052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.735092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a0af6-b560-4a88-8f9a-65eb8f98b7e7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.737872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.790280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c5c50-8513-47b3-a45a-3c40cde84df4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.827273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.827929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.828242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.828486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.829724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:24.831754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:24.833860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 200/397] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:24.839373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.850131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3105d-7111-47d4-9365-c3cbf1212c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:24.850737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3105d-7111-47d4-9365-c3cbf1212c98 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.851000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3105d-7111-47d4-9365-c3cbf1212c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.851600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3105d-7111-47d4-9365-c3cbf1212c98 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.853564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3105d-7111-47d4-9365-c3cbf1212c98 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:24.855015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3105d-7111-47d4-9365-c3cbf1212c98 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:24.857787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 198/398] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:24.859219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9b2a-bba7-4cd8-b951-52b63e3f069a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:24.859485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9b2a-bba7-4cd8-b951-52b63e3f069a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:24.859799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9b2a-bba7-4cd8-b951-52b63e3f069a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:24.861301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 199/399] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:24.866227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9b2a-bba7-4cd8-b951-52b63e3f069a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:24.930465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.962486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e560a98-1044-4781-ab74-5e6838381284 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:24.964363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:24.987819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9b2a-bba7-4cd8-b951-52b63e3f069a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.010403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d118ac4-54de-4513-a55b-9d1f7334f4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.011137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118ac4-54de-4513-a55b-9d1f7334f4f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.011421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118ac4-54de-4513-a55b-9d1f7334f4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.011696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d118ac4-54de-4513-a55b-9d1f7334f4f3 None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.015125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d118ac4-54de-4513-a55b-9d1f7334f4f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=96753d928a2342e69f156ffb28c8de92, group_id=6a76acc284aa4dc9ab870b52cf676af6, role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:25.016801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d118ac4-54de-4513-a55b-9d1f7334f4f3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:25.037188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 201/400] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 10:12:24 2022] PUT /identity/v3/projects/96753d928a2342e69f156ffb28c8de92/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/73a9432602da4fa9aed56acc5eae9592 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:12:25.042497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055db2-7a39-4e14-9b3d-4be113d6da8e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.042898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055db2-7a39-4e14-9b3d-4be113d6da8e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.043183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3055db2-7a39-4e14-9b3d-4be113d6da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.052106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.053095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.053548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.053993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.059212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:25.061060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:25.063332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 200/401] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:24 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:25.067863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d3055db2-7a39-4e14-9b3d-4be113d6da8e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:25.067863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d3055db2-7a39-4e14-9b3d-4be113d6da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:25.069389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.159165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 202/402] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:25.160464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449dd65-b605-48f3-b289-5a304e86c901 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.160756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449dd65-b605-48f3-b289-5a304e86c901 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.161063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449dd65-b605-48f3-b289-5a304e86c901 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.166622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 203/403] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:25.168154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.168441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.168745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.190035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:25.191291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:25.230428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4c32-2a4b-479d-a4b3-5c23285bf4d8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.271124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 204/404] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:25.271981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.277892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.279472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.279971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.280492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.283174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] RBAC: Authorizing `identity:create_grant(project_id=9276e465f98d46f2afdff2ecf1dbad50, group_id=6a76acc284aa4dc9ab870b52cf676af6, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:25.285195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:25.289544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:25.313182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 201/405] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 10:12:25 2022] PUT /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:25.314475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.327584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:25.450385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b834-c90d-493c-9332-bb67a540a563 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.493612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.494657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.495157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.495672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.509960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:25.516641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:25.517652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:25.518460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:25.519081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 202/406] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:25.527901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.532201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad646607-fb4a-40a7-b564-c509b9a1fa1e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.594557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.595226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.595505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.595775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.617341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:25.620936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:25.623687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:25.624682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:25.625512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:25.626124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 205/407] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:25.631983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.686968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7137a17-9038-4573-bc66-e2b67aae7b6a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.723294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:25.736181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.736832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.737133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.740873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.740873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:25.740873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:25.740873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:25.756291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29f892-9346-42cb-8beb-b1cdfba5b0e4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.762072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 203/408] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:25.768648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.851686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.852325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.852607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.852901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.853633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:25.853931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:25.855336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:25.880447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 206/409] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:25.884863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:25.896248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3ee08-91b8-477e-b8ea-a36127c51a02 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:25.925092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:25.967726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:25.968383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:25.968658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:25.968954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] PATH_INFO: `/v3/groups/00166be2659840f5bd5c25ad48be1453` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:25.970238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] RBAC: Authorizing `identity:get_group(group_id=00166be2659840f5bd5c25ad48be1453)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:25.971678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:25.976040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 204/410] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/groups/00166be2659840f5bd5c25ad48be1453 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:25.979059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:26.080689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0c723-fd67-42ed-8dbb-a40c74da88f6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.149766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.150425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.150701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.150975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.152308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:26.155396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:26.157344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 207/411] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:26.163058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:26.196200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:26.206033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de5e59-8710-4267-af63-81116cf7ddcf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.249969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbeca3-3e21-4457-a6c3-8732c26b2a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.250702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbeca3-3e21-4457-a6c3-8732c26b2a4d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.251299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbeca3-3e21-4457-a6c3-8732c26b2a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.251582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbeca3-3e21-4457-a6c3-8732c26b2a4d None admin] PATH_INFO: `/v3/projects/efd8d0a5798b4c52a018435ee59fbf54` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.252787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbeca3-3e21-4457-a6c3-8732c26b2a4d None admin] RBAC: Authorizing `identity:get_project(project_id=efd8d0a5798b4c52a018435ee59fbf54)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:26.254755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbeca3-3e21-4457-a6c3-8732c26b2a4d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:26.257237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 205/412] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:25 2022] GET /identity/v3/projects/efd8d0a5798b4c52a018435ee59fbf54 => generated 344 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:26.259136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9b58-6890-4379-b1bf-fbf4c13b5b1d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.259419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9b58-6890-4379-b1bf-fbf4c13b5b1d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.259693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b9b58-6890-4379-b1bf-fbf4c13b5b1d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.262285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 206/413] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:26.263112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b9b58-6890-4379-b1bf-fbf4c13b5b1d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:26.328528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b8b4a-1241-4e84-b4bd-f317cd8db0de None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.333941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:26.386419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38314f92-665b-44b1-9881-76480908d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.387587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314f92-665b-44b1-9881-76480908d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.388510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314f92-665b-44b1-9881-76480908d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.388980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38314f92-665b-44b1-9881-76480908d0d5 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.390438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38314f92-665b-44b1-9881-76480908d0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:26.392944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38314f92-665b-44b1-9881-76480908d0d5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:26.396101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 208/414] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:26 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:26.397903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.398820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.399563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.405695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b9b58-6890-4379-b1bf-fbf4c13b5b1d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.433742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:26.436288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:26.444322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.445031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.445352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.445631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] PATH_INFO: `/v3/projects/efd8d0a5798b4c52a018435ee59fbf54/groups/00166be2659840f5bd5c25ad48be1453/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.447665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] RBAC: Authorizing `identity:create_grant(project_id=efd8d0a5798b4c52a018435ee59fbf54, group_id=00166be2659840f5bd5c25ad48be1453, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:26.449280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:26.471231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 207/415] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 10:12:26 2022] PUT /identity/v3/projects/efd8d0a5798b4c52a018435ee59fbf54/groups/00166be2659840f5bd5c25ad48be1453/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:26.472805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:26.529153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 209/416] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:26.558894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:26.574287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:26.622527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34c36-ee00-4ff9-880f-4a646bc6605c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.637745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:26.671054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.673061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.673552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.673993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.676608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9276e465f98d46f2afdff2ecf1dbad50, group_id=6a76acc284aa4dc9ab870b52cf676af6, role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:26.678265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:26.696579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 208/417] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Jul 26 10:12:26 2022] PUT /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50/groups/6a76acc284aa4dc9ab870b52cf676af6/roles/73a9432602da4fa9aed56acc5eae9592 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:26.729999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41b714-7bc5-4230-8936-787896c0b62a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.786821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.787417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.787690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.788025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.804272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:26.809885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:26.810837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:26.811627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:26.812435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 210/418] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:26.818832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:26.939322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dcf4e-e114-42aa-9f39-c683649c75f6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:26.986494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:26.987388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:26.987846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:26.988263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:26.989191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:26.989653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:26.991235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:27.001653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 209/419] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:27.007086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:27.099240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:27.141976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dfb8e-36da-40be-bdf8-c9d01bc47eed None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:27.183273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ab9dd-dcbb-4485-b3ed-196fd957ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:27.183898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ab9dd-dcbb-4485-b3ed-196fd957ee6c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.184175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ab9dd-dcbb-4485-b3ed-196fd957ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.184444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ab9dd-dcbb-4485-b3ed-196fd957ee6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.259247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ab9dd-dcbb-4485-b3ed-196fd957ee6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:27.260723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520ab9dd-dcbb-4485-b3ed-196fd957ee6c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:27.332563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:27.367648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 211/420] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:27.373705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:27.470417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cdd7-b00f-40b0-b9bb-37850494ce3d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.470735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cdd7-b00f-40b0-b9bb-37850494ce3d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.470961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cdd7-b00f-40b0-b9bb-37850494ce3d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.472760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 212/421] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:27.476814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:27.478568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.478856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.479141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.506369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:27.507568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:27.624539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5faca-1b17-448f-8e59-12426938d7e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:27.643929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 213/422] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:27.679563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:27.680161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:27.680829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.681134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.681415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.684007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:27.686057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:27.689695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 210/423] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:27 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:27.693806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:27.836217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:27.845682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f26037-3f01-4757-927f-ac7f9277ba8a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:27.861215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:27.865793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773c314-e975-443d-8cd0-75da53e20aa9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:27.894296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca219d-6a64-4e49-af4d-712236c3e7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:27.894866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca219d-6a64-4e49-af4d-712236c3e7da None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.895150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca219d-6a64-4e49-af4d-712236c3e7da None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.895541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca219d-6a64-4e49-af4d-712236c3e7da None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.896828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca219d-6a64-4e49-af4d-712236c3e7da None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:27.898426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca219d-6a64-4e49-af4d-712236c3e7da None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:27.900452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 211/424] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:27 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:27.901656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81818f-ed21-433e-b745-954e606e254b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.901941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81818f-ed21-433e-b745-954e606e254b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.902216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81818f-ed21-433e-b745-954e606e254b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.904603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a24e1f-e321-4452-9123-8142e21c4958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:27.905437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24e1f-e321-4452-9123-8142e21c4958 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.905781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24e1f-e321-4452-9123-8142e21c4958 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.906115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a24e1f-e321-4452-9123-8142e21c4958 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.908965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 212/425] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:27.909822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81818f-ed21-433e-b745-954e606e254b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:27.927749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a24e1f-e321-4452-9123-8142e21c4958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-18a24e1f-e321-4452-9123-8142e21c4958 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:27.934983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:27.936973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:27.938866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 214/426] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:27.949125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:27.949125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:27.949125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:27.963011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:27.964293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:28.040874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81818f-ed21-433e-b745-954e606e254b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.049212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 215/427] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:28.050113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.096061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.096803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.097168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.097506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.098463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=96753d928a2342e69f156ffb28c8de92) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:28.098836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:28.100438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:28.108133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 213/428] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:27 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:28.109072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.176897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.179766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.194107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19620814-fffa-4b90-aa49-b93a020902d7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.258607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.259252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.259531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.259802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.260538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:28.260859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:28.268033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:28.287478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 216/429] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:28.293434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.331319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9312f-e284-49d7-909d-3ca7c3eee0f3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.384966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.385627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.385903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.386172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.397152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:28.403097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:28.404058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:28.404916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 214/430] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:28.410267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.443463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf48c10-cecf-454d-8ec3-8dbeae65a052 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.479642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.481256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.482284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.482761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.508224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.516161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.526038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db43765-3780-42a1-85fa-96ae42c1f375 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.562474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:28.563684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.564341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:28.564644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.565089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.565619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.566460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] RBAC: Adding query filter params (name=member) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:28.566906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:28.568451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:28.578141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:28.583860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.676393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 217/432] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:28.681978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.692171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc63381-b959-4862-ab7c-5a1a2d778eaa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.731004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.732433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.732895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.733331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.741928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.761568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.793753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606a165-bae2-40f7-94d9-1c5895331dd9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.812984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:28.814802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:28.830883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:28.831818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:28.832058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:28.832450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] PATH_INFO: `/v3/projects/96753d928a2342e69f156ffb28c8de92` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:28.833931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] RBAC: Authorizing `identity:get_project(project_id=96753d928a2342e69f156ffb28c8de92)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:28.835473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:28.837685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 218/433] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/projects/96753d928a2342e69f156ffb28c8de92 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:28.843760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.928179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 216/434] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:28.933957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:28.954618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b3ec1-7d4e-4e00-b2a9-25b6ed46910a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:28.976807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:28.999296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.000052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.000438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.000822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.002177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.002454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.003843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.005968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 219/435] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:29.012221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.057248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4581b2-bef4-4c46-880b-bd39f98f9c03 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.096549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76ada8-c77b-41fa-ab88-06c93dd96919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.097278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76ada8-c77b-41fa-ab88-06c93dd96919 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.097592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76ada8-c77b-41fa-ab88-06c93dd96919 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.098123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76ada8-c77b-41fa-ab88-06c93dd96919 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.099198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76ada8-c77b-41fa-ab88-06c93dd96919 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.100658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76ada8-c77b-41fa-ab88-06c93dd96919 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.102397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 217/436] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:28 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:29.103647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd67e-07bb-4d13-bd30-25ef47bfcf68 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.103873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd67e-07bb-4d13-bd30-25ef47bfcf68 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.104167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affd67e-07bb-4d13-bd30-25ef47bfcf68 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.111764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 218/437] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:29.111764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd67e-07bb-4d13-bd30-25ef47bfcf68 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.151107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e0368-a04a-437e-915c-294d539bd3f0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.200227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.201454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.201732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.202025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.202822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=96753d928a2342e69f156ffb28c8de92) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:29.203132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.204568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592a464-fd03-445f-b3bc-facba1c86fe0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.211790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 220/438] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=96753d928a2342e69f156ffb28c8de92&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:29.212595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e332551-521c-4639-9896-331a66ec9e96 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.213373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e332551-521c-4639-9896-331a66ec9e96 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.213373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e332551-521c-4639-9896-331a66ec9e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.238274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-2e332551-521c-4639-9896-331a66ec9e96 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:29.239519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2e332551-521c-4639-9896-331a66ec9e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:29.268545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affd67e-07bb-4d13-bd30-25ef47bfcf68 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.297973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.306286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.313809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377b9f4-e436-4230-a0e8-a62a26996568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.314548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377b9f4-e436-4230-a0e8-a62a26996568 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.314766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377b9f4-e436-4230-a0e8-a62a26996568 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.315040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377b9f4-e436-4230-a0e8-a62a26996568 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.316360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377b9f4-e436-4230-a0e8-a62a26996568 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.317923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7377b9f4-e436-4230-a0e8-a62a26996568 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.319652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 219/439] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:29.321097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024769f-52b2-4f73-85e3-39d80f6bfea2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.321351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024769f-52b2-4f73-85e3-39d80f6bfea2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.321624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024769f-52b2-4f73-85e3-39d80f6bfea2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.328048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 220/440] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:29.328048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024769f-52b2-4f73-85e3-39d80f6bfea2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.342939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 221/441] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:29.344155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.344515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.344905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.364960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:29.366229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:29.448424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 222/442] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:29.454482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.472739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024769f-52b2-4f73-85e3-39d80f6bfea2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.520307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.520884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.521364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.521502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.522209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=1fbe89ae01d844ef881e25c4ac0ed9c7, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:29.522515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.523961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.530328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 221/443] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:29.531306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.598442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834be341-50d5-40dc-97bc-275942ec7c33 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.620594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.624913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.652234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.652733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.653047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.653322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.665901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:29.672192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:29.673236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:29.674141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 223/444] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:29.681954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.691778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300697e-593a-46a3-bffd-9b9a69559c7a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.740143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.740800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.741111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.741380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.753328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:29.758752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:29.759896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:29.760967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 222/445] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:29.765868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.811210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8f114-f697-425a-927b-bd116c8b94c4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.852695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.853381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.853662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.853940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.854656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:29.854960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.857177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.866456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 224/446] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:29.872986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.882601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de393cea-8506-4a6b-8e82-b3c3859878b7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:29.900014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.912936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:29.930196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea77bee-57e2-4877-9872-982df910409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:29.930831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea77bee-57e2-4877-9872-982df910409a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:29.931111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea77bee-57e2-4877-9872-982df910409a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:29.931387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea77bee-57e2-4877-9872-982df910409a None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:29.932123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea77bee-57e2-4877-9872-982df910409a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:29.935780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea77bee-57e2-4877-9872-982df910409a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:29.935780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea77bee-57e2-4877-9872-982df910409a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:29.943606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 223/447] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:29.949881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea77bee-57e2-4877-9872-982df910409a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:29.992437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449f1de-57f8-42b0-88e2-b8d0548fa8c8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.026612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.027237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.027521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.027831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.056326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea77bee-57e2-4877-9872-982df910409a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.090782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.092020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.092230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.092501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.102197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.103702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.136824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:30.139459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:30.163672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.165162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.202532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 225/448] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:12:30.208281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:30.271455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 224/449] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:30.277334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:30.325312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398f96d-a827-4d66-a377-d6be3eb34b1f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.361266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:30.362713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.363386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.363789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.364075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] PATH_INFO: `/v3/projects/efd8d0a5798b4c52a018435ee59fbf54` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.365429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=efd8d0a5798b4c52a018435ee59fbf54)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.366923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.368650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 226/450] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:30 2022] GET /identity/v3/projects/efd8d0a5798b4c52a018435ee59fbf54 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:30.374268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:30.377268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:30.385635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f80cc0-e5ec-4922-9f19-5bbd310c16da None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.428050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.428764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.429074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.429353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] PATH_INFO: `/v3/projects/9276e465f98d46f2afdff2ecf1dbad50` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.430534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] RBAC: Authorizing `identity:get_project(project_id=9276e465f98d46f2afdff2ecf1dbad50)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.432005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.434088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 225/451] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:12:30 2022] GET /identity/v3/projects/9276e465f98d46f2afdff2ecf1dbad50 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:30.439423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:30.482952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a2a58-0026-4333-9e39-898dc3e9d2d0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.518595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.519251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.520038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.520038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] PATH_INFO: `/v3/groups/00166be2659840f5bd5c25ad48be1453` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.522712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] RBAC: Authorizing `identity:get_group(group_id=00166be2659840f5bd5c25ad48be1453)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.524171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.525833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 227/452] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:30 2022] GET /identity/v3/groups/00166be2659840f5bd5c25ad48be1453 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:30.532384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:30.558397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe24c9-5807-4515-ac54-3854605abb34 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.593715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.594357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.594644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.594921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] PATH_INFO: `/v3/groups/6a76acc284aa4dc9ab870b52cf676af6` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.596116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] RBAC: Authorizing `identity:get_group(group_id=6a76acc284aa4dc9ab870b52cf676af6)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.597625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.599246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 226/453] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Jul 26 10:12:30 2022] GET /identity/v3/groups/6a76acc284aa4dc9ab870b52cf676af6 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:30.605028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:30.606528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:30.622287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:30.647733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cecb3-fb46-492c-bc4d-b4e780e1b6db None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.683580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.684226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.684513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.684817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.685641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] RBAC: Adding query filter params (group.id=00166be2659840f5bd5c25ad48be1453, role.id=2b446efbd008435f977d0068496eb403, scope.project.id=efd8d0a5798b4c52a018435ee59fbf54) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:30.685952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.687393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b09bfc-fcf5-4410-9074-72e5a4e57429 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.699491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 228/454] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:30 2022] GET /identity/v3/role_assignments?group.id=00166be2659840f5bd5c25ad48be1453&scope.project.id=efd8d0a5798b4c52a018435ee59fbf54&role.id=2b446efbd008435f977d0068496eb403 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:30.719392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884f57d-5a94-447f-b5e3-fe1c122bd280 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:30.758932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:30.759574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:30.759858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:30.760130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:30.760978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] RBAC: Adding query filter params (group.id=6a76acc284aa4dc9ab870b52cf676af6, role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=9276e465f98d46f2afdff2ecf1dbad50) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:30.761288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:30.763309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0511cfb-685d-40c2-8124-003108312413 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:30.770361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 227/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Jul 26 10:12:30 2022] GET /identity/v3/role_assignments?group.id=6a76acc284aa4dc9ab870b52cf676af6&scope.project.id=9276e465f98d46f2afdff2ecf1dbad50&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:33.430597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6789e-55af-4676-87db-240ffe5a1ebb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.431123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6789e-55af-4676-87db-240ffe5a1ebb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.431200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6789e-55af-4676-87db-240ffe5a1ebb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.432954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 229/456] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:33.447472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722664-4c02-45a4-820f-a35b9d3e77cd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.447989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722664-4c02-45a4-820f-a35b9d3e77cd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.448259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0722664-4c02-45a4-820f-a35b9d3e77cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.489803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a0722664-4c02-45a4-820f-a35b9d3e77cd None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:33.492661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a0722664-4c02-45a4-820f-a35b9d3e77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:33.620974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 228/457] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:33.668221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6789e-55af-4676-87db-240ffe5a1ebb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:33.818714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6789e-55af-4676-87db-240ffe5a1ebb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:33.860580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:33.861269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.861548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.861869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.865815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bf88-553e-4b6f-9a4d-69fa5ad401be None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.866144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bf88-553e-4b6f-9a4d-69fa5ad401be None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.866411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5bf88-553e-4b6f-9a4d-69fa5ad401be None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.868020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:33.868334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:33.874694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.875141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.875292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.898912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:33.909374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:33.910928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:33.934017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:33.936003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-44a29f61-a493-4405-9763-06b54f4b9c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:33.954217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:33.955724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:33.957400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:33.957400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:33.957400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:33.957400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:33.961061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 230/459] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:33.965704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a827-da0a-48f7-8667-4c89f60b64fe None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.965704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a827-da0a-48f7-8667-4c89f60b64fe None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.965704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a827-da0a-48f7-8667-4c89f60b64fe None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.965704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 231/460] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:33.971021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:33.971305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:33.971567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:33.995925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:33.998035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:34.034293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 230/461] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:34.035628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.101935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 232/462] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:34.102816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.166753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a001e-a98e-410f-a3db-6c07cf67c8ce None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:34.208098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:34.208696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.209148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.209429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.210155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:34.210475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:34.211947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:34.216428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:34.235280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 231/463] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:34.236332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.257909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3628c-c4c4-4f8b-aa1e-0658831ec4af None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:34.282702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:34.316087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:34.316776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.317130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.317527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.331964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:34.333891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:34.352466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:34.353414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:34.355105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:34.355105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:34.355105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:34.355105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:34.355105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 233/464] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:34.355105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.387099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceba57-e9c5-4839-8c62-0bb1288fe257 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:34.436635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:34.437504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.437779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.438059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.449999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:34.452030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0650f1ec-19f7-4afe-af3e-d5cc1f6c7ea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:34.475446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:34.476599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 232/465] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabb8b-d8df-45f6-ae09-a763fc3c3adc None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabb8b-d8df-45f6-ae09-a763fc3c3adc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.483471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adabb8b-d8df-45f6-ae09-a763fc3c3adc None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.487827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 233/466] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:34.488830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adabb8b-d8df-45f6-ae09-a763fc3c3adc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.509706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a153daf-ad00-425b-b3f9-185c11ec49d9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:34.554434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:34.556947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:34.557652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.557940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.558233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.558954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:34.561045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:34.596887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 234/467] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:34 2022] POST /identity/v3/users => generated 246 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:34.596887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.636299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adabb8b-d8df-45f6-ae09-a763fc3c3adc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:34.641361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:34.689259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:34.689976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.690263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.690555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.691368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:34.691679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:34.693278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c38d2-4da7-4ebc-b36f-2d510b1ce0a1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:34.716409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 234/468] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:34.716409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954872-522e-4023-827c-c57849c490f9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.716409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954872-522e-4023-827c-c57849c490f9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.716409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954872-522e-4023-827c-c57849c490f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.738999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d3954872-522e-4023-827c-c57849c490f9 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:34.740291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d3954872-522e-4023-827c-c57849c490f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:34.782880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73329-02eb-437a-bba2-959ce63df96d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:34.831644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:34.832280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:34.832563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:34.832832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:34.833567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:34.833866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:34.835278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:34.850369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 235/469] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:34.851344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.858963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 235/470] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:34.858963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954872-522e-4023-827c-c57849c490f9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:34.923685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:35.007982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954872-522e-4023-827c-c57849c490f9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.008741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:35.013454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d1f1d5-4488-4796-9f32-7e2dd97680b2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.053610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.054287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.054561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.054836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.055524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:35.057012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:35.061261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1f70f-8ac9-46bd-9729-2b186bb27b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.061927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f70f-8ac9-46bd-9729-2b186bb27b3f None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.062225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f70f-8ac9-46bd-9729-2b186bb27b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.062495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1f70f-8ac9-46bd-9729-2b186bb27b3f None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.063189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f70f-8ac9-46bd-9729-2b186bb27b3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:35.064727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1f70f-8ac9-46bd-9729-2b186bb27b3f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:35.082684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 236/471] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:34 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:35.083574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:35.100929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 236/472] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:34 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:35.103048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278b4f-df74-485c-9c75-c5dad399f76d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.103722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278b4f-df74-485c-9c75-c5dad399f76d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.104241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278b4f-df74-485c-9c75-c5dad399f76d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.109490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 237/473] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:35.117569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.118276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.118768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.162633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:35.164786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:35.215039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b9ca7-2134-4b6b-899a-48bed0c8928e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.257999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.258671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.258948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.259239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.272575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:35.273410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:35.275158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:35.296035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:35.297006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:35.297892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:35.297892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:35.297892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:35.297892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:35.297892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 237/474] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:35.303522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:35.367002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 238/475] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:35.394699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:35.428247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:35.469616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d563a-c435-481b-94d5-b58135ebf662 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.525650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.526567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.526804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.527181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.528032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:35.529033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:35.530906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:35.539626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788039-bb41-4c98-9e43-63dc01f964eb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.547218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 238/476] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:35.552201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:35.578280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.579237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.579659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.580072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.581023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:35.582598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:35.592148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.sql.core [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 10:12:35.592148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 10:12:35.592148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [parameters: {'id': 'cdaaa5c6975848f991cf029dc02e3789', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 10:12:35.592148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 26 10:12:35.610669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:12:35.611654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application yield resource Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise self.value Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application session.commit() Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 10:12:35.612649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.flush() Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application compat.raise_( Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 10:12:35.613590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:12:35.614482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:12:35.615287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [parameters: {'id': 'cdaaa5c6975848f991cf029dc02e3789', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:35.616132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 10:12:35.617154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:35.619873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 239/477] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 10:12:35 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:35.625792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:35.627595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:35.694764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd17d-f9e0-4aa4-94c3-323b2ce645d7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.760865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:35.777244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20765837-96c1-4bd7-8f49-52c9d2cdb308 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:35.819595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62c46-4421-4c27-8d42-7c8ce597e009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.820921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62c46-4421-4c27-8d42-7c8ce597e009 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.821314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62c46-4421-4c27-8d42-7c8ce597e009 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.821722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62c46-4421-4c27-8d42-7c8ce597e009 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.822237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:35.822680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62c46-4421-4c27-8d42-7c8ce597e009 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:35.823189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:35.823604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:35.824009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:35.830556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62c46-4421-4c27-8d42-7c8ce597e009 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:35.837754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:35.848451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:35.850400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 10:12:35.852177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:35.856869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 240/478] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:12:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:35.862969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:35.875673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 239/479] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:35 2022] POST /identity/v3/users => generated 249 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:12:36.026531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546ed58-b1c0-4544-9437-9d722518dd4b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:36.087363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:36.088173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:36.088458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:36.088735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:36.089563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:36.090006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:36.092146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa5dd51-a535-46c4-aaef-571565311db6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:36.104438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 241/480] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:37.320273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423ffea-8cb6-4f0e-b0c3-a227de94e402 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:37.320858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423ffea-8cb6-4f0e-b0c3-a227de94e402 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:37.320858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423ffea-8cb6-4f0e-b0c3-a227de94e402 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:37.322381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 240/481] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:37.327885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:37.328740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:37.329231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:37.357919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:37.359501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:37.363220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:37.458829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:37.496522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423ffea-8cb6-4f0e-b0c3-a227de94e402 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:37.641623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423ffea-8cb6-4f0e-b0c3-a227de94e402 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:37.652902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:37.695715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565f961-18a5-417d-ae19-a3a94fee7f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:37.696390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565f961-18a5-417d-ae19-a3a94fee7f96 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:37.696670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565f961-18a5-417d-ae19-a3a94fee7f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:37.696969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565f961-18a5-417d-ae19-a3a94fee7f96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:37.713902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565f961-18a5-417d-ae19-a3a94fee7f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0565f961-18a5-417d-ae19-a3a94fee7f96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:37.719972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:37.721095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:37.722166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 241/483] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:37.727310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:37.791952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402cc87-b498-4f90-9861-52af3ed69cfc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:37.792313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402cc87-b498-4f90-9861-52af3ed69cfc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:37.792492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402cc87-b498-4f90-9861-52af3ed69cfc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:37.794965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 242/484] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:37.802313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:37.802599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:37.803129 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:37.826633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:37.827870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:37.915877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d19d69-bcba-4f9c-abd2-01ee189e6058 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:37.965256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 243/485] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:37.974761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:37.975402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:37.975682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:37.975959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:37.976688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:37.977031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:37.978452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:37.988325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 243/486] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:37.995676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.014255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.020269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.140634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360ba5d-e5c1-47b9-9c27-d4a90ae1026d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.180973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c309f-ed76-4eed-b0f2-93336d24ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.181573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c309f-ed76-4eed-b0f2-93336d24ec8b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.181863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c309f-ed76-4eed-b0f2-93336d24ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.182132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c309f-ed76-4eed-b0f2-93336d24ec8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.198062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c309f-ed76-4eed-b0f2-93336d24ec8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:38.199742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a35c309f-ed76-4eed-b0f2-93336d24ec8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:38.207409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:38.209208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:38.210808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:38.212943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed128035-39ec-4d45-b2f6-b86e7909b6c7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.213635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 244/487] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:38.215258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfe300-1e0e-4efd-9512-0a56b7c1ff58 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.215611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfe300-1e0e-4efd-9512-0a56b7c1ff58 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.216762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfe300-1e0e-4efd-9512-0a56b7c1ff58 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.220777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 245/488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:38.222310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfe300-1e0e-4efd-9512-0a56b7c1ff58 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.270782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.271432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.271768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.272044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.286373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:38.287867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-64499ead-e61b-4791-8d38-3de36d79d0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:38.307672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:38.308606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:38.310069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:38.310069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:38.310069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:38.310069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:38.310069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:38.310968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.311246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.311517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.322437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.337661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:38.338861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:38.372658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfe300-1e0e-4efd-9512-0a56b7c1ff58 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.408360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.408793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.409123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.409394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.410123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:38.410405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:38.411901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:38.421301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 246/490] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:38.422244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 245/491] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:38.422357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.426932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.541275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.566962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b5b43-f923-4189-b362-18e34cb7340d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.567151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703136ac-ccb1-4305-aa63-e2430a970f6f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.593651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.606831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.607463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.607745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.607957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.608069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.608715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:38.609050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:38.609353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.609833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.610292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.610479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:38.622738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:38.624529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:38.625193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 247/492] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:38.626135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:38.642231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:38.643140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:38.643999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:38.643999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:38.643999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:38.643999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:38.650600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 246/493] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:38.651800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.741148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebfd66-d1dc-44ee-b179-8c3b29551ade None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.763976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c17085-6a7b-47e5-8923-e76289bf743f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.779440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.780264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.780478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.780760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.792958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:38.798975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:38.800447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:38.802322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:38.803220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:38.806436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 248/494] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:38.808301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.808865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.810558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.811051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.811520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.820728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:38.822566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:38.838203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:38.839219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:38.840133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:38.843488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 247/495] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:38.844545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:38.864509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:38.929008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef85c-9eb4-4a06-a2cc-73912302f1dd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.967359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9c42e-b66f-4eeb-8223-6e34061bc37e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:38.972407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:38.973089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:38.973372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:38.973645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:38.974380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:38.974687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:38.976860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:38.990470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 249/496] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:38.991354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.004741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.005408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.005686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.005999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.006689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:39.006994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.008370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4d00d-d905-48c4-a7be-d4fa267fa362 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.017245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 248/497] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:39.018484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013506f-8404-4040-869c-e065232ef078 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.018768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013506f-8404-4040-869c-e065232ef078 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.019039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013506f-8404-4040-869c-e065232ef078 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.020404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 249/498] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:39.021318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a2caf-6534-4158-8036-fe0ee892fe30 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.021596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a2caf-6534-4158-8036-fe0ee892fe30 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.022069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a2caf-6534-4158-8036-fe0ee892fe30 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.023072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 250/499] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:39.026020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a2caf-6534-4158-8036-fe0ee892fe30 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.085631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.098637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d37c7-0767-457a-9f42-d237c4e4560e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.100981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.132391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a2caf-6534-4158-8036-fe0ee892fe30 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.134275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.134894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.135171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.135445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.136236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:39.136538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.138656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.166788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.167422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.167699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.167973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.175986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 250/500] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:12:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:39.176136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.176729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.177362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4be18504-b9e7-4f8a-bbc1-ce6c7c700f23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:39.190116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:39.191087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:12:39.191993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:39.192504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 251/501] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:39.193912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2307b5-c021-439a-a609-74226e08e9aa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.193912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2307b5-c021-439a-a609-74226e08e9aa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.194091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2307b5-c021-439a-a609-74226e08e9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.212832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ec2307b5-c021-439a-a609-74226e08e9aa None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:39.214092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ec2307b5-c021-439a-a609-74226e08e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:39.280038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4470504-4507-40f8-88d6-5806a03e1be1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.281150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 252/502] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:39.282490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.282775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.283047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.303838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:39.305151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:39.315484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.316135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.316481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.316755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.326948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.328652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:39.344159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:39.345279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:39.346180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:39.346180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:39.346180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:39.346180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:39.346180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 251/503] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:39.346180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.348864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.367836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.377230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 253/504] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:39.378090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.458626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ce83f-484c-4817-b522-c7f7bce144f2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.504478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.505150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.505436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.505714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.507344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc62cb7-98df-47a6-921e-333401242b21 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.548673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.549334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.549614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.549885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.550756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:39.550993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.552529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.586978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.588555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.593117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 254/505] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:39.593973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.609756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.631223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.720906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1b802-f4b1-4206-b547-ed5f0aa415b4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.721410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 252/506] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:39.722398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.756632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.757339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.757616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.757901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.769643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:39.774846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:39.775993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 255/507] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:39.777135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.836381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39a56b-95cc-4b87-a9e8-1fc152749220 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.859405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.884637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:39.886870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.888283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.888726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.888995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.889710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:39.890088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.891471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.896021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154e4b6-b92f-44c6-9e72-11e7b679c4db None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:39.904295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 253/508] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:39.905542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:39.940641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:39.941314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:39.941597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:39.941892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:39.954373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:39.955858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:39.972013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:39.973168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:39.974014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:39.974014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:39.974014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:39.974014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:39.974014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 256/509] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:39.974273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.017383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c6a24-3ead-46a7-9a61-0bb40df78276 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.060864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.061816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.062312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.062802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.091530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132dd0c-5f7b-447c-8709-82216837d2c0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.117632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.131952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.132592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.132886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.133163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.146644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.147692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.148289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.149377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.151414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:40.165179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:40.166095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:40.166957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:40.166957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:40.166957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:40.166957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:40.166957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 257/510] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:40.167241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.269744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 254/511] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:40.270614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.280574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13719fa-7924-4901-b091-9a5c82d63c69 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.317077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.317797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.318203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.318542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.319331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:40.319700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.321179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.330197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 258/512] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:40.331153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.358887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.386347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a28a-56e1-49da-81af-514170aeb9a5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.394786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.423083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.423614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.423893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.424161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.431560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.433062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.438980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7d0b7-b8ea-4c4b-9768-e8af735ea0c2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:40.448072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:40.449108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:40.450031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 255/513] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:40.450645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.485489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.486195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.486473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.486742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.487441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:40.487770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.489236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.504398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 259/514] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:40.506564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.584536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073159c-5118-4879-8cf2-c13b4ed1f57d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.620961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fcd59-249a-4b5e-a546-21656cf85e90 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.624214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.624987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.625277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.625571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.626471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:40.626782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.628209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.630006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.639418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.642735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 256/515] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:40.643629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.668266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.669576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.669846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.670114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.682415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.683816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:40.700573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:40.701826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:40.702714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:40.702714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:40.702714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:40.702714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:40.702714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 260/516] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:40.702714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.761782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfe125-e639-4f64-ab2f-e389a83ba739 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.803256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.804421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.804711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.805126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.818626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.819951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.824099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e203-4a53-4ff9-8aea-d4e05040df1a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:40.839469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:40.840471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:40.842021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:40.842021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:40.842021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:40.842021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:40.842021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 257/517] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:40.843137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.865483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:40.867356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:40.867649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:40.867925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:40.868740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:40.869082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:40.870569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:40.894043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 261/518] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:40.896239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:40.904794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.929958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:40.974361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01cc1-36d1-479b-97c0-48e7c781ee70 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.011246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.011876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.012157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.013159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.013316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19103ca-f39f-40ab-b0f4-ce1ca6ca247f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.013750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.015198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.052601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 258/519] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:40 2022] POST /identity/v3/users => generated 247 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:12:41.052601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.056577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.057287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.057566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.057842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.069074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.070624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:41.084811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:41.086623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 262/520] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:41.088274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.207995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317959d-fe98-4aab-8b7b-5a0163e23518 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.209890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:41.228313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:41.242735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250151f-340e-4778-9f15-ce74f749698e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.267995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.268726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.269046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.269412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.270222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:41.270583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.272040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.286944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 259/521] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:41.287139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.287765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.287882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.288040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.288365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.293298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:41.293621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.295112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.312610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 263/522] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:41.313351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.439981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f1c70-0e07-437f-a6ef-cd5e11ce11c2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.456682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f076e5d-a7b6-48a4-af26-479fca1826b7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.493650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.494203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.494663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.494993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.509696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.509970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.510308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.510613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.511469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:41.511783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.513894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.540887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 264/523] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:41.541087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:41.541169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.556600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:41.591804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.593373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.688472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f9f2-5af1-4ade-9f10-23d0c16c0470 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.727142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 260/524] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:41.727142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.746398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.747856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.748304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.748654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.758193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.759740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:41.772644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:41.773584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:41.774452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 265/525] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:41.775016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.817795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:41.861678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:41.874805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d9700-68d4-4a5d-8dee-e3dbb321696d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.909210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e18f6-b210-43c3-a71b-b75d5e8fb260 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:41.912193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.912888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.913289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.913588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.922770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.924443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:41.944056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:41.945090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:12:41.945997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:41.953655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 261/526] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:41.954344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:41.968023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:41.968769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:41.969120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:41.969463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:41.970467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=038cbaf398214c2cbca2383eb8fa7fa5) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:41.970770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:41.972238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:41.978951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 266/527] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/role_assignments?user.id=038cbaf398214c2cbca2383eb8fa7fa5&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:41.979783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.123158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b76da0-d407-42c5-918f-452dec62030c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.154019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:42.168421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29af20c-0392-443e-9451-08d286fae3c4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.169662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.170625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.171170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.171657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.187962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.189908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:42.208032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:42.209279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:42.210260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:42.210260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:42.210260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:42.210260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:42.212479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 262/528] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:42.213665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.215016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.216338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.216622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.216923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.217805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:42.218115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.219838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.222521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:42.236490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 267/529] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:42.237476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.339094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a903a-b408-4164-a469-063c85c91b4f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.366499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538ecd6-b64f-4d9f-b1b4-22465bdab42b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.377880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.378860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.379375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.379861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.380990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:42.381564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.383323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.405183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 263/530] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:42.406432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.424397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.425117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.425393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.425669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.426457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:42.426760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.428258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.441522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 268/531] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:42.442546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.455894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:42.524497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:42.539024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46840f0e-054b-4f13-a024-876c44613e73 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.571498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c6e37-65ed-43bf-ae8a-d131591fc776 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.576380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.577034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.577318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.577588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.578388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=82bfade65449437b928932715d5e8a4e) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:42.578700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.580160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.586433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 264/532] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/role_assignments?user.id=82bfade65449437b928932715d5e8a4e&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:42.587476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.624629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.624629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.624629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.624629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.765654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:42.766164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.767574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.775987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5292f-509e-4066-94b8-7f1303a2b901 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:42.833936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:42.860582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:42.861102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:42.861389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:42.861668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:42.878133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:42.879619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:42.894883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 269/533] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:42.899623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:42.900471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:42.901366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:42.903725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:42.904945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 265/534] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:42.907085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.021674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce021ad7-0f2f-49b3-afde-ecb2f9a5beca None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:43.090282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:43.093042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.093042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.093042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.093042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:43.093042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:43.094584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:43.125690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 266/535] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:43.131832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.136446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391b139-06af-4344-98aa-a653f5cab27e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:43.167729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:43.212369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:43.213274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.213559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.214037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.242024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:43.243560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:43.257964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e229c-8925-4255-a45d-bcb9ff13269a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-80803337-7f52-4937-9bd8-19a00938a51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:43.261467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:43.262301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:43.263698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:43.263698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:43.263698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:43.263698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:43.263698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 270/536] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:43.268861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec1ab-2fff-4547-ac4b-2402bd3cd40b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.268984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec1ab-2fff-4547-ac4b-2402bd3cd40b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.269343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffec1ab-2fff-4547-ac4b-2402bd3cd40b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.270685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 271/537] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:43.273388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffec1ab-2fff-4547-ac4b-2402bd3cd40b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.279419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:43.305277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:43.306431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.306713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.306984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.307812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=0c3969e48a534d8babef2991941c01bb) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:43.308120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:43.309640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9158-5383-4d41-9359-d499a8e33ba6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:43.316144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 267/538] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:43 2022] GET /identity/v3/role_assignments?user.id=0c3969e48a534d8babef2991941c01bb&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:43.317403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.317689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.317966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.349428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:43.349428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:43.477997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 268/539] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:43.481441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffec1ab-2fff-4547-ac4b-2402bd3cd40b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:43.502526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.515025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:43.527140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:43.527696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.527993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.528823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.529567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:43.529872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:43.531252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:43.543933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 272/540] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:43.549332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.670664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:43.674281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b62bd-a175-4687-8b77-032edf5b332a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:43.744215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94c207-5227-4bb9-a543-bd2bc53abbe5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:43.747912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:43.748642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.750609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.750972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.771878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:43.777791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:43.778892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:43.779911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:43.784861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 269/541] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:43.787117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.816877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:43.817832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:43.818260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:43.818685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:43.836196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:43.849295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:43.893293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:43.895297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:43.897384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:43.905224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 273/542] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:43.910816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:43.943140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:44.000886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83108648-9b25-4b88-8d61-1e01e459ec87 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.047376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a0389-53bd-4743-837e-956cc842dd61 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.075898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:44.077394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.078230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.078513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.078789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.079592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:44.079970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.086298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.089670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.090316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.090629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.090905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.091683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:44.091990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.093660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.101579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 270/543] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:44.108761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 274/544] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:44.109790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.114136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.224195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80004450-1cc2-4a4a-9020-ea335a789d9e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.261769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.262468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.262754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.263029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.263836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=99a24c94f072452f8924a76f97ff2683) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:44.264147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.265783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.272241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 275/545] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/role_assignments?user.id=99a24c94f072452f8924a76f97ff2683&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:44.277205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57531703-0b24-48b3-a475-90abc5e2dcb3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.332560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:44.342043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.342699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.342983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.343254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.365336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.366832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:44.390532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:44.392584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:44.394695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:44.394695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:44.394695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:44.394695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:44.394695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 271/546] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:44.397435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.457278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:44.521704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461320a-bd86-4f95-8373-9caa3ffe8ec6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.577730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.578502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.578678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.578895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.579605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:44.579909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.581335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ab5db-f81d-4d7a-9cdc-9a6f3f52844a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.600164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 276/547] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:44.605890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.644736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802aaf-9500-46f5-9301-58820dedc98b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.644736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802aaf-9500-46f5-9301-58820dedc98b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.644736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802aaf-9500-46f5-9301-58820dedc98b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.645750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 277/548] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:44.651532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.652159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.652653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.677920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:44.679501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:44.773823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8049ed17-e4b2-45c0-9549-bc095847676b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:44.816641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:44.817434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.817719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.817993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.830273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:44.832178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d0077a78-9fc7-4205-bd00-329d2cd9a8d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:44.849661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:44.851189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:12:44.852265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:44.856500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 278/549] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:44.862656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 272/550] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:44.868142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.884343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60ce3c-d495-4e3f-81c0-856803344bd0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:44.885038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60ce3c-d495-4e3f-81c0-856803344bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:44.885512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60ce3c-d495-4e3f-81c0-856803344bd0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:44.887367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 273/551] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:44.897000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60ce3c-d495-4e3f-81c0-856803344bd0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:44.933231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:44.959749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.026826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60ce3c-d495-4e3f-81c0-856803344bd0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.027181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ec8d2-cca4-4547-8616-1397e6053ec1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.076576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.077241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.077555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.077886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.078803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:45.079214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:45.080869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.081024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dfd5d-248f-407c-928a-aba051965fd9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:45.081933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.082435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.083054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.098396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:45.104630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:45.106020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:45.106912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:45.107554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 279/552] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:45.108430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.108726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.109032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.110570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 274/553] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:45.111569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.145080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:45.146902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:45.236621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 280/554] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:45.237995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.242126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288cfc-c2f6-49e5-a457-d8b2a2fe1b1c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.249000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.283416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.291434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.292180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.292554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.292983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.370002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99128ef-45ed-4e68-868a-50bb5ade83d7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.381808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:45.384205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:45.411167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.412001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.412662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.412662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.413604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:45.414189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:45.415757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:45.430077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 281/555] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:45.430077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.526961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 275/556] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:45.526961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.529488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.553648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.567781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62f052-e371-4f5f-bd48-1321e9e13ac3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.603284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.603951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.604204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.604392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.617757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:45.625278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:45.626268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:45.627114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:45.630800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 282/557] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:45.631733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.667628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee80079-ccf1-4151-add1-4628e4b049b4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.712612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.713594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.714047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.714482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.732801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:45.734980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:45.760307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:45.762813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:45.764390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:45.764390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:45.764390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:45.764390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:45.764390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 276/558] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:45.764390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.781967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8434-e4ef-476e-95f4-2e119f15a79a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.819974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.820624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.820931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.821211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.825672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.832767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:45.834415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:45.844429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-84b58913-eaa2-43f2-96af-67a42a7d3fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:45.851857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:45.853027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:45.854240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:45.854240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:45.854240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:45.854240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:45.861667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 283/559] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:45.862986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4161-22d1-46e2-bf15-26b5d75eedbc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.863268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4161-22d1-46e2-bf15-26b5d75eedbc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.863541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4161-22d1-46e2-bf15-26b5d75eedbc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.864832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 284/560] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:45.865544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f4161-22d1-46e2-bf15-26b5d75eedbc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.882343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe0cf-c59b-485c-ab2a-49653807a40d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:45.917703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:45.918646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:45.919580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:45.920013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:45.920910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:45.921223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:45.922592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:45.931391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 277/561] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:45.932034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:45.985532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f4161-22d1-46e2-bf15-26b5d75eedbc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.020076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.021021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.021485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.021955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.022836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:46.023143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.024524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c24d6-152f-4096-8172-9ceed32f314a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.046739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 285/562] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.046938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb100a-6c25-4808-aaf6-7eb5a0bc5dc1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.047059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.047059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.047059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.062362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:46.063562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:46.066247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.084344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.084995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.085275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.085542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.086234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:46.086534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.087894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.100473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 278/563] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.101331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.130301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.152969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 286/564] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:46.152969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.220287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3eb74e-0154-4eca-b93d-e06129b6934b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.255371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c4172-884b-42a0-87b9-e187346adee3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.257230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.257991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.258266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.258581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.269642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.271187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:46.287428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:46.288376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:46.289745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:46.289745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:46.289745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:46.289745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:46.289745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 279/565] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:46.289745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.295740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.296408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.296687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.296993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.304777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.306265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:46.318077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:46.319065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 287/566] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:46.320019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.327329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.373910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.410160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d96c-6b77-4581-9232-db1a7f4ec890 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.436653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc4a1-af6e-4245-aa74-bd81281610a3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.454055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.454743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.455071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.455379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.463801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.465426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:46.479134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:46.480144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:46.481480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 280/567] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:46.482522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.494351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.495293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.495715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.496087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.507851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:46.513798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:46.514743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:46.515603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 288/568] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:46.516301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.593239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.603365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539f59-8a96-4491-80a5-287d81e0a333 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.618974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cdd88-c3fb-4fe9-b85c-8647384609d2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.629886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.638999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.639623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.639902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.640171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.640900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:46.641205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.642586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.653871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.654401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 281/569] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.654500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.654770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.655049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.655208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.655850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:46.656161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.657618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.676189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 289/570] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.677275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.763696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228d185-34e7-459f-9c89-4b2954ca38e5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.776342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8038a2a-56e4-402f-b071-01ae60041aa1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.798131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.798748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.799028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.799299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.800045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:46.800349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.801898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31de8-7b32-4c84-a7c9-e503a6102f6e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.808822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.810105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.810385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.810654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.811372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:46.811668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.813032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.814123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 282/571] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.815388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c645-be0b-4c77-a1f7-48812bc9b7c8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.815674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c645-be0b-4c77-a1f7-48812bc9b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.815948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c645-be0b-4c77-a1f7-48812bc9b7c8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.817421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 283/572] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:46.817909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c645-be0b-4c77-a1f7-48812bc9b7c8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.827273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 290/573] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:46.828504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.834882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.860122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:46.927294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c645-be0b-4c77-a1f7-48812bc9b7c8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.929763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb757f-f544-4c0a-9c2c-c144ecb47148 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:46.961326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.961962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.962241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.962520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.966331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:46.966980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:46.967259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:46.967537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:46.970098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.971537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.978067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:46.979496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:46.983547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:46.984647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 284/574] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:46.985645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-47164fc3-cd8a-4f9a-8249-10cc01bb428e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:46.998351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:46.999303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.000209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:47.000209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:47.000209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.000209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:47.000209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 291/575] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:47.000670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.000960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.001258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.018318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:47.019518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:47.066168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.087367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 292/576] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:47.088229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.101723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.114992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c789b-8f6e-4af3-bcfa-ebd5d58bfb2b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.147865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.148480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.148764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.149060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.149838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=7005963bb5b241c2b24a3fe6eab876dd) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.150146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.151563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.159274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 285/577] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:46 2022] GET /identity/v3/role_assignments?user.id=7005963bb5b241c2b24a3fe6eab876dd&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:47.160127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.196080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510f75f-34e1-4a3f-9a22-9271ecfb3c4a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.236997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.237670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.237948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.238218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.250069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.251579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:47.268737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.269937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.271080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:47.271080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:47.271080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.271080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:47.274739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 293/578] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:47.275718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.282061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce5820-e02e-4c4e-a614-5f4816cc9ef0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.320741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.321409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.321690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.321962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.323815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.323815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.325331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.327364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.349838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.350408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 286/579] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:47.351305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.395695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59e983-1087-49cb-9fed-6a452b0a10f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.433348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.434020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.434445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.434721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.435420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.435723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.437278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.450866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 294/580] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:47.451669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.464450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d69bb5-622d-45a7-b19a-127320565c46 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.502052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.502812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.503093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.503368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.514293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:47.519702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.520708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 287/581] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:47.521685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.570630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fc550-78b6-4103-a39f-253737578e47 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.582949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.598411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.611072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.611703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.611984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.612265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.613003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.613310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.614723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.626665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 295/582] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:47.627642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.642461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38a04b-1ce2-4b90-8f60-a6289158a83e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.677626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.678382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.678665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.678982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.689318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.690773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:47.707400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.708536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.709643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:47.709643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:47.709643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:47.709643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:47.709643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 288/583] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:47.709643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.743741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a45377-92b7-4004-9c47-72c7441fc4ba None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.780549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.781338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.781617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.781887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.789901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.791789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:47.804452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.805502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 296/584] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:47.811531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.825622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66057073-37c9-447c-8f68-8fd272086564 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.829306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.862025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:47.865232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.865924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.866295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.866639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.867431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:47.867811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.869294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.878137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 289/585] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:47.878845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.926402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64f63a-c920-4067-8824-1e2dff003572 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:47.963566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:47.964144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:47.964424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:47.964696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:47.973972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:47.975455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:47.988196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:47.989275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:47.990240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 297/586] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:47.990835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:47.999988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c412a7-0857-44c2-8ceb-cb7b5305c16d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.042149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.042790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.043070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.043559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.044088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:48.044390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.045857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.065903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 290/587] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:48.065903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.096904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.117226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc79e6-7749-42f6-bce4-81c8c73b9923 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.119993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.155151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.155785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.156074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.156348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.157152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:48.157468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.158923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.172563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 298/588] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:48.173470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.186240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95233b1a-ba52-4237-8bd2-d2f711d484c6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.223759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.224326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.224608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.224903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.238536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.240023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:48.257029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:48.257993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:48.258985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:48.258985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:48.258985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:48.258985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:48.258985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 291/589] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:48.258985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.297674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f869e-b9ac-4bef-9db2-cfb100e71242 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.335690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.336733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.337183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.337699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.338506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:48.338818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.340281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.346890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.362913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 299/590] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:48.364095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.377227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626062b-7d18-45e0-89a0-12f746e06a9f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.396229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.413782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.414428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.414711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.414986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.421870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.423330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:48.435526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:48.436446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:48.437379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 292/591] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:48.437871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.481614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bc9e2-35a6-4118-86ea-b394f06c755f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.518347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.519022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.519299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.519572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/038cbaf398214c2cbca2383eb8fa7fa5/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.536072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=038cbaf398214c2cbca2383eb8fa7fa5, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.537988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.550274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba6073-7911-47f1-90d1-aad7991f869e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.561196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 300/592] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:48 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/038cbaf398214c2cbca2383eb8fa7fa5/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:48.561196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.617666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.618295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.618574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.618846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.619622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:48.619927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.621384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.631230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.639093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 293/593] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:48.640124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.674066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.720445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194fb4e-9e68-4d01-9c8e-12363e0bdfd6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.769833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.771184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.771676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.772146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.789832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c21fc6-b833-4b96-8137-854d8e89bdd7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.790109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:48.815238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:48.816199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:48.817693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:48.817693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:48.817693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:48.817693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:48.818339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 301/594] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:48.822408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.838024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.839182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.839722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.840194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.841719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:48.842353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.844235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.859550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 294/595] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:48.860999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:48.930834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6518750-448c-42cf-ab9a-0880cdf35911 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.932617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.957440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:48.969302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:48.970156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:48.970305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:48.970527 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:48.978462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:48.979931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:48.987872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be88a3-6b44-4c92-9bdd-9deb4ad4bc74 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:48.992000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:48.993257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 302/596] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:48.994254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.030771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.031858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.032405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.032938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.033841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:49.034348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.036136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.054419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 295/597] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:49.055814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.118740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5ced-c703-42cb-bdd9-6f101455cdb1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.156864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.157537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.157818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.158095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/82bfade65449437b928932715d5e8a4e/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.170078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7c046-4177-4763-bbce-a96a92081e59 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.175035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=82bfade65449437b928932715d5e8a4e, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.176592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.191618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:49.195809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 303/598] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:48 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/82bfade65449437b928932715d5e8a4e/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:49.196811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.214508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.215585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.216118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.216604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.217832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:49.218464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.220180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.243085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 296/599] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:49.249772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.252600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:49.343870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1570c-7711-4174-9eb8-5a412c977a5e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.384663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd3667-8afb-4bde-b57f-57a628e9caca None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.392007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.392719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.393035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.393360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.401478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.402961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2f75ffec-6081-4056-a18d-a1cb154b5261 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:49.419046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:49.419988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 304/600] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c52c-a7c3-4ef5-9858-7bb285c874ba None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.425034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c52c-a7c3-4ef5-9858-7bb285c874ba None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.425781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41c52c-a7c3-4ef5-9858-7bb285c874ba None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.425781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 305/601] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:49.428577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41c52c-a7c3-4ef5-9858-7bb285c874ba None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.435742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.436397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.436680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.436984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.450955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.453265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5c8b5b4d-40df-42bc-89da-f3d8d445bf18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:49.472191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:49.473190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:49.474170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:49.474170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:49.474170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:49.474170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:49.474406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 297/602] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:49.475950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.476590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.476891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.501973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:49.504103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:49.532434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:49.536293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:49.542639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41c52c-a7c3-4ef5-9858-7bb285c874ba None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.581459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.582204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.582664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.583006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.583990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:49.584367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.585995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.598594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 298/603] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:49.599610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.608102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 306/604] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:49.615254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.738717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12026d3-79ba-4bd6-a760-272905cf83d7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.754065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d863-71d3-4d5e-8903-3f32f0b59fa2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:49.776768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.777604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.778525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.778878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/0c3969e48a534d8babef2991941c01bb/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.795735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=0c3969e48a534d8babef2991941c01bb, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.797287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.798461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:49.799258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:49.799772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:49.800194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:49.801595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:49.801856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:49.803304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:49.817197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 307/605] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:49 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/0c3969e48a534d8babef2991941c01bb/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:49.818423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.821000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 299/606] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:49.822328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:49.830049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:49.864503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:49.986660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde5ca-317f-4d05-91cf-bd69b1e2c817 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.023532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.024200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.024484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.024762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.032864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.034654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.040698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1264bf0-7a11-4c60-8f8f-50b397ea0fd7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:50.047303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:50.048223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:50.049152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 300/607] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:50.057954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.087337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.088519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.088809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.089385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.104035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:50.111751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:50.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:50.118057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 308/608] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:50.121148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.175242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.192230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.203028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e216d-c567-42a8-a6d1-944e216cbb97 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.240871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670c79-5778-4ccd-b1b4-43a95173efd6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.248590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.249252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.249536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.249815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.250674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:50.250988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.252554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.275303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 301/609] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:50.283014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.283651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.284292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.284571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.284861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.285605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:50.285908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.287280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.296538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 309/610] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:50.305878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.398972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba798d-2972-43aa-882e-d3c94855843b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.438603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907adfff-bcab-4ed3-bea8-e50841a699e8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.444395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.445115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.445401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.445791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/99a24c94f072452f8924a76f97ff2683/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.460650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.470966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.474459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.475113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.475391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.475660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.475825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=99a24c94f072452f8924a76f97ff2683, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.477529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.488716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.490350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:50.506699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:50.509025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:50.510447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:50.510447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:50.510447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:50.510447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:50.510447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 310/611] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:50.511437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 302/612] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:50 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/99a24c94f072452f8924a76f97ff2683/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:12:50.518173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.677505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ad056-0925-4130-99ff-a710319fdd4e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.715114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.715933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.716304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.716690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.717520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:50.717920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.719381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d3691-ebc7-48da-900b-400bffaf1063 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.734286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 311/613] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:50.740028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.796267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be4913-76cc-4db8-bfcf-f91d1d16cfe0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.796802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be4913-76cc-4db8-bfcf-f91d1d16cfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.796802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be4913-76cc-4db8-bfcf-f91d1d16cfe0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.799563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 312/614] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:12:50.803873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.804158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.804436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.826152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:50.827363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:50.862834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:50.865624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761e499-b7ab-4b3f-9d65-baeb10f53ec3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:50.908592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:50.909462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:50.909822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 313/615] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:12:50.912973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:50.913503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:50.921958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:50.923693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:50.937536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:50.938497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:12:50.939441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:50.941809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 303/616] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:50.952498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:50.954730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.045855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.076307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7ece-38d3-42f5-b347-58d5109f296b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.118881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.121504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.121820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.122097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.122894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:51.123202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.124631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.152583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392a61-2b8c-4776-9a5a-1803720bd47c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.163638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 314/617] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:51.171187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.233317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.266289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.266979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.267259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.267532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.301582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:51.303252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f66b-95f7-40ec-a572-d631e3484eaa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:51.307240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:51.308252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:51.309181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 304/618] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:51.317183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.348188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.348883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.349173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.349451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.390692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.392524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:51.420574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:51.421788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:51.422702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:51.422702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:51.422702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:51.422702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:51.431858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 315/619] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:51.451972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.500397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686f3cf-c6b0-41e0-8462-f84b249d0aba None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.514789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.562515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.563163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.563452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.563729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.564459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:51.564769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.566197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.569410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.582719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d4808-cacb-4c59-ab55-a6a48971df80 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.584348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 305/620] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:51.589841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.633658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.634297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.634577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.634852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.635550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:51.637916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.641458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.666799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 316/621] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:51.670618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.775372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b02b0-899c-4dd3-9efe-19a362a06bdf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.834541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.835489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.835773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.836051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.837122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d94945-9d4b-402d-ba73-b9a5c8a34414 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:51.849543 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.851302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b2f107ca-b766-4ef5-b862-7b25690a5bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:51.870864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:51.872571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:51.873552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:51.873552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:51.873552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:51.873552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:51.873552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 306/622] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:51.876963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5f27-4d84-499c-88d9-127d6b6a7378 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.876963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5f27-4d84-499c-88d9-127d6b6a7378 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.876963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5f27-4d84-499c-88d9-127d6b6a7378 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.876963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 307/623] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:51.879518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:51.880174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.880454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.880728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.881994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5f27-4d84-499c-88d9-127d6b6a7378 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:51.891698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:51.893703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:51.896127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d3fe57fb-fdee-4c18-bdb1-3286a4fd23eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:51.909112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:51.910490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:51.911631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:51.915754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 317/624] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:51.917251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:51.917488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:51.917599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:51.917801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:51.940731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:51.942359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:52.011872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5f27-4d84-499c-88d9-127d6b6a7378 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.043265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 318/625] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:52.045333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.049553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.050073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.050073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.050258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.050932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:52.051235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.052637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.067749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 308/626] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:52.073243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.171642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.187062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dd20a-b026-460d-8c7f-35cdb49beb6f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.194542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112c517-4ac7-4676-8149-f2bb05e662d0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.224932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.233191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.233950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.234299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.234647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.237060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.238614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.239169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.239625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.240551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:52.241107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.242820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.244322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.245985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:52.261471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:52.262563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:52.263626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:52.264603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 319/628] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:52.266398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 309/628] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:52.266398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.267582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.379448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ae669-6206-48da-b147-88bef5359f46 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.396339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3517251-ac47-4edb-a396-11324117bf62 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.416565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.417230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.417510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.417792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.422320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:52.422653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.424128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.434293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce00b6-f433-49e4-8ad0-f4f74abe07b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.434967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce00b6-f433-49e4-8ad0-f4f74abe07b3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.435224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce00b6-f433-49e4-8ad0-f4f74abe07b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.435497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce00b6-f433-49e4-8ad0-f4f74abe07b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.451435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 320/629] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:52.451435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.451724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce00b6-f433-49e4-8ad0-f4f74abe07b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-00ce00b6-f433-49e4-8ad0-f4f74abe07b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:52.453759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:52.455400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 310/630] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:52.457929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8a580-12b8-4ad0-a375-0c9f4d5a67a6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.462517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8a580-12b8-4ad0-a375-0c9f4d5a67a6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.462517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8a580-12b8-4ad0-a375-0c9f4d5a67a6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.462517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 311/631] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:52.463297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8a580-12b8-4ad0-a375-0c9f4d5a67a6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.466355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.512715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.569063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d58d21-87d1-48a7-b4e2-86736f90d3ca None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.583403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8a580-12b8-4ad0-a375-0c9f4d5a67a6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.604301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.605008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.605292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.605828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/7005963bb5b241c2b24a3fe6eab876dd/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.619941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b45f1eb-c27d-4cbe-9b69-e1e9daaa9592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.620223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=7005963bb5b241c2b24a3fe6eab876dd, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.620596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45f1eb-c27d-4cbe-9b69-e1e9daaa9592 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.620868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45f1eb-c27d-4cbe-9b69-e1e9daaa9592 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.621155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b45f1eb-c27d-4cbe-9b69-e1e9daaa9592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.622270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.664953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 321/632] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:12:52 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/7005963bb5b241c2b24a3fe6eab876dd/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:12:52.664953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.729337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45f1eb-c27d-4cbe-9b69-e1e9daaa9592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.731494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b45f1eb-c27d-4cbe-9b69-e1e9daaa9592 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.733733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.835754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:52.845878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdfe84-42cd-4218-b10f-469cc7c8de84 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:52.872324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 312/633] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:52.874221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.874785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.875271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.891661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:52.892359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:52.892645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:52.892955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:52.893714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:52.894023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:52.895385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:52.897905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:52.899094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:52.906487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 322/634] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:52.908778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:52.978287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 313/635] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:52.979403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.033678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.045279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bde86-e1bb-436d-8db2-9d1142e91f4e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.082260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.082916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.083197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.083970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.096946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.098430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.111602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e33dd-2aba-427c-b7c4-2f662162f30a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:53.114375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:53.115290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:53.116195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:53.116195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:53.116195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:53.116195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:53.116195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 323/636] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:53.116811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.134461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.154908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.155976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.156533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.156820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.171418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.173754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3b0b3cca-298c-48d0-b17c-947d08b0805e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:53.194671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:53.195654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:53.196669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:53.196669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:53.196669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:53.196669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:53.200766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 314/637] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:53.202145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af6c25-7fec-4fdf-99d8-6bcd9b9ae180 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.202435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af6c25-7fec-4fdf-99d8-6bcd9b9ae180 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.202711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af6c25-7fec-4fdf-99d8-6bcd9b9ae180 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.204466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 315/638] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:53.205062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af6c25-7fec-4fdf-99d8-6bcd9b9ae180 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.235589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30473-3685-435d-90db-42105b5d2999 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.271973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.272734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.273163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.273445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.285202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:53.290571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:53.291658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:53.292506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:53.297397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 324/639] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:53.298286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.302916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.319819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af6c25-7fec-4fdf-99d8-6bcd9b9ae180 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.359139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.359766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.360048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.360320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.361053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:53.361360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.362783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb704a-4adf-49eb-8404-1a874deaef5f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.379367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 316/640] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:53.379555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.379638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.379638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.379638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.399017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:53.400240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:53.420249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c6b6b-f882-44b5-82ff-1d1a7c7b4a63 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.457179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.457719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.457996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.458265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.458958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:53.459263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.460627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.472752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 325/641] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:53.473655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.482033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 317/642] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:53.483100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.569991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.596045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a800-09f7-4583-8c06-26c0b6d8b3a0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.602910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980735c1-de94-4f1a-b447-bf6fba7bc644 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.633144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.633916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.634195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.634472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.634781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.641536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.642151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.642429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.642701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.643139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.643410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:53.643709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.645099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.645327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.658618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 326/643] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:53.658618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:53.658869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:53.659763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 318/644] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:53.660693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.773654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f98aa-81c5-4d9a-9104-f2bed48b7cf5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.774288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbbc64-18c7-47c1-80db-8f467d09d30b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.814557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.815212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.815497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.815773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.817456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:53.818039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.818149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:53.818360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:53.818631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:53.827077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:53.828519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:53.829616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:53.835088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:53.836132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 319/645] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:53.837183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:53.848712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:53.850161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 10:12:53.851320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:53.853258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 327/646] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:53.854399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:53.918048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:53.962273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834945-9c72-4f8f-a0bf-1d371df7b295 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:53.972463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a896369-df5d-49ce-9521-0c9c6dba80c8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.001841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.002487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.002958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.003082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.007536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.008152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.008426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.008695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.009467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.009769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.011198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.014825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.016279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.028480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 328/647] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.028480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:54.039825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:54.040775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:54.041723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:54.041723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:54.041723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:54.041723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:54.045022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 320/648] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:54.046039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.094757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.134200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9e3a7-685d-4e27-a829-72b2724b018d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.149486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.155255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636992-d777-4880-ba71-999d93708ba2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.172797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.173569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.173850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.174429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.175159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.175463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.177306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.189914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 329/649] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.189914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.199490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.200413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.200696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.201012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.201808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.202112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.203700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.225938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 321/650] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.226907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.290285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a78e39-b56c-4d5b-a475-48fa8ead4d36 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.323815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.324535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.324982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.325259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.326070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=038cbaf398214c2cbca2383eb8fa7fa5) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.326430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.327869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.334875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 330/651] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/role_assignments?user.id=038cbaf398214c2cbca2383eb8fa7fa5&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.335697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.352217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6314f7-5d95-4fb4-9a1c-2923b21c019f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.357225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.393412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.394269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.394894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.395833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.396350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.397558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.398023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.399704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.417307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 322/652] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.418540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.471422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55669f4d-eb7d-4169-9cb4-700322f66442 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.511200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.512796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.513250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.513706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.528440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.530298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:54.550633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:54.551579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:54.552492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:54.552492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:54.552492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:54.552492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:54.555477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 331/653] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:54.556140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.567802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2324d2-0a0f-408b-a937-c2ec0b11eef9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.622264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.623655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.624434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.624947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.680114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.701027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.715240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e2251-62af-4ddd-b191-da43c805717d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.715454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.717046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.761797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.762490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.762772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.763100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.771905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.773447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:54.786781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:54.787809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:54.788757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 332/654] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:54.790084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.857814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 323/655] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:54.857814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.914655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fd293-01db-4843-9814-377d62bf7df5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.920998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:54.952398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:54.953091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.953377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.953657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.954370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:54.955155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:54.956557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34753e-f483-4898-afb9-0c13b7e8d038 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:54.967603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0f60-ff3e-47f5-81fd-cc06be8c3738 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:54.970056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 333/656] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:54.971398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79cb01-924b-432c-b821-cc2706c4c5d0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:54.971690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79cb01-924b-432c-b821-cc2706c4c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:54.971970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79cb01-924b-432c-b821-cc2706c4c5d0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:54.973220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 334/657] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:54.973921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79cb01-924b-432c-b821-cc2706c4c5d0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:54.991764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.010967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.011597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.011881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.012185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.013013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:55.013324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.014805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.034101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 324/658] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:55.034797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.099786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79cb01-924b-432c-b821-cc2706c4c5d0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.136313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.136915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.137758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.138023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.147442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7815488-48d0-4c0b-bc6d-36d40668419c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.148888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.150355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-04514cca-c521-4354-9eab-352c50a9122d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:55.165848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:55.166778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:55.167685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:55.167685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:55.167685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:55.167685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:55.167685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 335/659] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:55.168447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.168734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.169034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.179282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.188165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:55.189457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:55.194134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.194687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.195090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.195488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.203929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.205442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:55.218150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:55.219158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 325/660] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:55.220140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.256092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.273032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 336/661] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:55.273032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.336787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcba7d-dc62-4bfd-9ace-d79fdb022f71 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.373746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.374379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.374659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d28ac-3f6a-44d9-b593-cda5dcc3623e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.374772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.374965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.409610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.410149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.410431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.410704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.411392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:55.411696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.413091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.424489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 337/662] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:55.427337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.429948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.447730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.449258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.484509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.534628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01b6e7-8f2a-4459-8a24-c907bb6185e4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.558500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 326/663] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:55.560086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.576241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.576989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.577336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.577680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.578546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:55.578917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.580403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.604065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 338/664] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:55.604065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.652173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.672725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896de54-cbb3-4fed-8060-cb5b119308d1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.709466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.709784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc1cb-c549-49b2-b67b-4adc6be1883c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.710112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.710391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.710663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.721219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:55.722120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:55.727209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:55.728264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 327/665] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:55.729775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.755845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.756494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.756761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.757069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.764784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.766320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:55.778871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:55.779782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:55.780739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 339/666] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:55.781783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.841573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7127ad-db7e-438b-8716-9dee4ee4a9e0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.876513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.877256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.877533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.877798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.886306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e214a514-6c3a-4abd-993f-6ca52d2c8e2d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:55.888870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:55.890551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:55.892439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:55.907544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:55.908485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:55.909439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:55.909439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:55.909439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:55.909439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:55.909439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 328/667] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:55.909718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:55.926965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:55.927556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:55.927817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:55.928098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:55.971227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.005724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.007700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.026077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b360694-2b57-4414-8ea2-1d7862b19ad7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.064596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.065283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.065564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.065840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.066546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.066847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.068212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.076811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 329/668] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.081948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.119635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 340/669] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:56.120486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.148315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.197372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6613fd3-9902-435b-8bcd-f5c86944138c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.201972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.232459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.233110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.233398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.233677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.234432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.234741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.236188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.238161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226879fe-5d7b-4692-bb38-a08a6a406300 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.249679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 330/670] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.250525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.283832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.284449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.284725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.285025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.285720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.286013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.287370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.304798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 341/671] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.304798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.362751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea94544-020d-4879-ae1a-11cdfeb08c26 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.380777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.399898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.400555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.400873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.401148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.407938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba16939-9a7c-443d-81f9-eafffed06dac None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.413181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.414759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:56.430671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:56.431776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:56.432834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:56.432834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:56.432834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:56.432834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:56.432834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 331/672] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:56.433142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.444466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.450756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.451338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.451631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.451891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.463173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.464950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:56.482145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:56.483099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:56.483995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:56.483995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:56.483995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:56.483995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:56.483995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 342/673] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:56.484282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.545880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a3c29-5bae-4094-9f47-20a6c96a6d91 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.579758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.580515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.580798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.581105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.581908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=82bfade65449437b928932715d5e8a4e) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.582221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.583699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.590752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 332/674] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/role_assignments?user.id=82bfade65449437b928932715d5e8a4e&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.591715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.591816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457926a-1d9f-4be5-a318-c4d32aca45b7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.627964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.641616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.642398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.642679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.642950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.650829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.652346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:56.665191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:56.666184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:56.667119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 343/675] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:56.667600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.724946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2471c9-8024-498e-b2d3-718891966d9c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.736682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.778618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.779267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.779549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.779822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.780899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.780899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.782289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31f774-9b52-482e-936b-9dc03176d12a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.796279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 333/676] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.797632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f7ae-81bc-462c-b6e3-08971ff00c74 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.797917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f7ae-81bc-462c-b6e3-08971ff00c74 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.798193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042f7ae-81bc-462c-b6e3-08971ff00c74 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.799421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 334/677] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:56.800102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042f7ae-81bc-462c-b6e3-08971ff00c74 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.814456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd0d6b-e26a-4781-bfde-ed217d8201f7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.853020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.853947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.854468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.855045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.856876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.857368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.858934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.873101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 344/678] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.874259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:56.902280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:56.912823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042f7ae-81bc-462c-b6e3-08971ff00c74 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.954753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:56.955385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.955669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.955945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.956711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:56.957052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:56.958497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296ae0c-ef6b-464c-a403-2d98feced614 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:56.972899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 335/679] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:56.972899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:56.973150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:56.973242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:56.994386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:56.994578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1534cb-8663-45f9-b900-3d2b52234280 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:56.995343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:56.996155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.037707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.038362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.038645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.038916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.048070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.049618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:57.064184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:57.066191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 345/680] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:57.068139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.081455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 336/681] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:57.081455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.168161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.182943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac912c58-c469-4091-a8be-28a13715f8e6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.191073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257aa58-9c2b-40d9-8cfd-0af39f58b899 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.221675 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.222318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.222601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.222875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.229737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.230238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.230446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.230971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.231737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.232140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.232539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=0c3969e48a534d8babef2991941c01bb) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:57.232832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.234331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:57.244504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:57.245510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:57.246533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 346/682] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:57.247031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 337/683] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/role_assignments?user.id=0c3969e48a534d8babef2991941c01bb&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:57.247121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.247774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.286204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.383190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb8fa6-b983-41d0-a6bc-2620c2af433a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.409909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744efc3d-0d44-4996-b05a-fd38cf0d0beb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.428091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.428878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.429071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.429458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.430346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:57.430538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.431945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.454691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 347/684] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:57.456674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.457830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.458491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.458772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.459046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.471766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:12:57.477231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:57.478373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 338/685] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:57.479368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.494079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.555698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.587632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c37620-6d29-4b02-bc76-da5b323b9a91 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.609319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4a85b-df19-46b1-a5d7-44ea7b1a7cb1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.635737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.636367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.636657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.637734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.638921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:57.639241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.641252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.646808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.647553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.647933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.648304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.664502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 348/686] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:57.665451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.731607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.733147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.741670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.800191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a87ed-2feb-476e-814f-4fa160601d00 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.844991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:57.845746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:57.846034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:57.846312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:57.847159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:57.847472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:57.848906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:57.859099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 349/687] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:57.860040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.868630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 339/688] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:12:57.869530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:57.874385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:57.969294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ae8e3-648f-4d53-ab1c-260555eaf88d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:57.992734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23360b64-45ed-419f-92dd-f08485317389 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.003309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.010380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.011974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.013120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.013602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.014633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=99a24c94f072452f8924a76f97ff2683) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:58.015173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.017123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.024721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 350/689] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/role_assignments?user.id=99a24c94f072452f8924a76f97ff2683&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:58.025969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.039765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.040446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.040731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.041048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.053808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.055429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:58.074153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:58.075759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:58.076659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:58.076659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:58.076659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:58.076659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:58.076659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 340/690] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:58.081820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.116372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.161638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee2c4a-e13e-46b4-8b2b-2e390967f4bd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.202173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0dba2-061d-478c-b39b-048337b31601 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.205212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.206284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.206773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.207255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.222184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.224118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:58.241465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:58.242455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:58.243441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:58.243441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:58.243441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:58.243441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:58.245940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 351/691] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:58.269516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.273773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.274437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.274705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.274984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.275707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:58.276015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.277515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.291816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 341/692] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:58.298080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.327470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.415431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde42b8-7054-41a4-94ab-8473baa2c383 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.437257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.443097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b77f45-8d82-49f4-8b84-6f8bca1d5e68 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.459539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.460338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.460621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.460919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.463216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:58.463216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.463758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.481160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 352/693] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:58.486806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.488683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.489621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.490211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.490643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.501988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.503919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:12:58.523163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:58.524213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:12:58.525205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:58.527569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 342/694] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:58.533646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.650903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939634f-b434-4ad8-8d88-faa23e3dde43 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.675385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.711150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78401749-c718-408c-9f80-2f5f29fbfbad None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.722681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.723176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.723454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.723727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.739560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.741045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.752323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.753265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.753786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.754224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.755151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:58.755610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.757298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:58.761614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:58.763230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:58.764254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 353/695] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:58.774095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.782873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 343/696] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:58.788937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:58.860212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.910258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8439ca-6bdc-4ea9-9801-a73c22309214 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.935867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3baba-e45e-49c8-bcba-11d7e65e5b65 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:58.954427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca2e63-0ad5-4ab7-865b-d377265be7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.955074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2e63-0ad5-4ab7-865b-d377265be7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.955352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2e63-0ad5-4ab7-865b-d377265be7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.955770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca2e63-0ad5-4ab7-865b-d377265be7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.961210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:58.988390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:58.989101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:58.989328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:58.989605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:58.990361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:58.990669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:58.992099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c98df-b84a-464f-a9b0-770d56064284 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.005622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 354/697] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:59.006984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83188aa-d815-4f17-8503-f9054c77fa57 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.007274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83188aa-d815-4f17-8503-f9054c77fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.007555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83188aa-d815-4f17-8503-f9054c77fa57 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.013347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 355/698] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:59.014819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83188aa-d815-4f17-8503-f9054c77fa57 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.044117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca2e63-0ad5-4ab7-865b-d377265be7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.046072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca2e63-0ad5-4ab7-865b-d377265be7c4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.132920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:59.138737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83188aa-d815-4f17-8503-f9054c77fa57 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:59.164218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 344/699] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 10:12:59.165677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.165966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.166237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.179567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:59.180590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.181124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.181605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.182639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=7005963bb5b241c2b24a3fe6eab876dd) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:59.183164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.185492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.188126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:12:59.189312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:12:59.193566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 356/700] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:12:59 2022] GET /identity/v3/role_assignments?user.id=7005963bb5b241c2b24a3fe6eab876dd&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:59.194804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.222695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:59.266039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 345/701] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:12:59.297521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.364448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919dc0b-883c-421b-927c-0f42ca795307 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:59.433472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:59.434203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.434490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.434772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.449715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.451942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.464792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511405a-64dd-4b5b-88f4-e2f703638c90 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:59.470365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:59.471461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:59.472649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:59.472649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:59.472649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:59.472649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:59.472649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 357/702] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:12:59.482438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.502482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:59.506223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:59.506878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.507159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.507431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.520704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.522265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:12:59.538936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:59.541033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:59.543128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:12:59.543128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:12:59.543128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:12:59.543128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:12:59.549102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 346/703] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:59.550064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.571044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:59.601777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4cf3a-3307-4639-a8bd-da9917c9d0ce None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:59.651979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:59.653299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.653577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.653791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.654495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:59.654910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.656407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.668322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5182-fe6b-4397-86eb-58293a4690ef None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:59.682010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 358/704] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:12:59.688490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.716038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:59.716737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.717039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.717314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.718073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:12:59.718383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.719901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb69165-fa7a-4ade-a5b6-48ec79c24d20 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.740996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 347/705] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:12:59.743167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce305-5b50-48bf-b34f-13f4a98d6fd2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.743624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce305-5b50-48bf-b34f-13f4a98d6fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.744070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fce305-5b50-48bf-b34f-13f4a98d6fd2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.746659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 348/706] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:12:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:12:59.751840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce305-5b50-48bf-b34f-13f4a98d6fd2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:12:59.829267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:12:59.861631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d088725-2787-43c6-8664-b363d0bf09fc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:12:59.920052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:12:59.921041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.921596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.922015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:12:59.933585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:12:59.936053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-24bf145b-b64f-47d3-9627-944b4b234e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:12:59.965149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:12:59.967535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:12:59.969410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:12:59.979138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 359/707] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:12:59.982033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:12:59.982693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:12:59.983338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.007395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:00.008605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:00.034787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:00.059690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fce305-5b50-48bf-b34f-13f4a98d6fd2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:00.083574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 360/708] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:00.084500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:00.097736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:00.098637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.099113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.099546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.100420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:00.102150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:00.136916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 349/709] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:12:59 2022] POST /identity/v3/users => generated 254 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:00.136916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:00.178805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:00.260000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8af69-7160-4b22-baa1-78c357f3db16 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:00.330936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:00.332951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.333060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.333336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.334097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:00.335347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:00.335834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:00.351521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4968e-64c9-40c1-9c0e-40ba6540e2f8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:00.359508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 361/710] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:00.362297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:00.411303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:00.411728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.412096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.412433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.413174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:00.414794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:00.422526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:00.440005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:00.441919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:00.443008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 350/711] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 26 10:13:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:00.447355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:00.494519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8fcf0-7b5a-465c-b871-5e971fe6ceb0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:00.545416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:00.573622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:00.574594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.575167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.575623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.576600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=038cbaf398214c2cbca2383eb8fa7fa5) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:00.577129 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:00.578787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73faf66-1856-47a3-87d2-220860cfc39c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:00.598324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 362/712] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:00 2022] GET /identity/v3/role_assignments?user.id=038cbaf398214c2cbca2383eb8fa7fa5&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:00.663534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2366b4b-9d47-4754-91d3-31f8d74527d4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:00.698712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c829-52da-435c-ba9c-e68278b45fd5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.698712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c829-52da-435c-ba9c-e68278b45fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.698712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595c829-52da-435c-ba9c-e68278b45fd5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.708881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 363/713] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:00.708881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.708881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.708881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.734291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:00.735355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:00.735610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:00.736051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:00.736522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:00.737468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:00.737593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:00.738093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:00.739697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:00.763163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 351/714] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 10:13:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:00.768463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:00.875264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 364/715] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:00.914158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:00.916677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:00.969352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5b210-6bf3-41cf-a0ae-4c5caf72c5db None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:01.019837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:01.021425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.021703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.021972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.022649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:01.022947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:01.024319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:01.038470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 352/716] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 10:13:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:01.115012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521f283-7dbf-4124-9197-263aaf6862a8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:01.150177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:01.172288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:01.172975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.173257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.173528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] PATH_INFO: `/v3/services/network` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.174169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:01.175542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:01.187260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:01.188320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:01.189183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 365/717] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:00 2022] GET /identity/v3/services/network => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:01.194321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:01.315190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60961c9-fc98-4213-a2ff-a20938ac408d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:01.349196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:01.361566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:01.363014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.363520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.363993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.364899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] RBAC: Adding query filter params (name=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:01.365420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:01.366995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d3e758-53f2-4114-8e06-06288a798b49 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:01.377104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 353/718] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:01.382589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:01.521733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d9e0-a725-437b-bb80-5b0ed816545e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:01.569547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:01.570573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.571080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.571556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.572445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:01.572978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:01.575180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526251-8c5d-45e5-b1aa-a0a46bb58347 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:01.581637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 366/719] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:01.821016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c37d8-8d17-4c8c-887c-fc405df1512b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.821671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c37d8-8d17-4c8c-887c-fc405df1512b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.822179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c37d8-8d17-4c8c-887c-fc405df1512b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.824052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 354/720] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:01.829605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a653958-26fb-47cd-8320-df2037088969 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:01.829890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a653958-26fb-47cd-8320-df2037088969 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:01.830171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a653958-26fb-47cd-8320-df2037088969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:01.857853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7a653958-26fb-47cd-8320-df2037088969 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:01.859050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7a653958-26fb-47cd-8320-df2037088969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:01.921531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:01.963379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 367/721] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 10:13:02.003844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c37d8-8d17-4c8c-887c-fc405df1512b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.166466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c37d8-8d17-4c8c-887c-fc405df1512b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.219999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.220666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.220969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.221240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.241717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:02.246990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:02.248048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:02.249397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 355/722] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:02.254712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a653958-26fb-47cd-8320-df2037088969 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.484078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a653958-26fb-47cd-8320-df2037088969 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.543240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.543869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.544151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.544429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.545175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:02.545476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.546835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.559411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 368/723] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:02.569995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.644735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.715851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7af91c-b829-434d-a5d1-1ffa2070dc09 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:02.769701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:02.770678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:02.771173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:02.771643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:02.785692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:02.787487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:02.806887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:02.807835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:02.809412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:02.809412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:02.809412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:02.809412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:02.811655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 356/724] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:02.820980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:02.885548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:02.961331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243ac8f-1e9a-408c-b451-66f9a05ccad3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.004330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.004992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.005273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.005544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.006244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:03.006542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.007923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea5d9e-68bd-4026-9847-5889f1b639a9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.026072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 369/725] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.031979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.140988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759f1a9-10bb-409f-ba0f-77f8b90c0380 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.141319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759f1a9-10bb-409f-ba0f-77f8b90c0380 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.141537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759f1a9-10bb-409f-ba0f-77f8b90c0380 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.143028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 370/726] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:03.148431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.148712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.149020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.183405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:03.188241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:03.199387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aebd6-8447-4816-83ea-24d2012f32e8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.201902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.268393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 371/727] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:03.286198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.286792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.287076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.287349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.292761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.301738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.303343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.323039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:03.326222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:03.327227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:03.328189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 357/728] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:03.337460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.403934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d147d2f-989b-44d4-8de3-a32cf84f85f1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.442690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.443606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.443999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.444367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.456800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:03.462255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:03.463415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:13:03.464325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:03.466385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 372/729] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:03.471960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.575511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.585529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cefdf-a86e-42de-aa82-c0a3844ebdc6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.624666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.625585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.625877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.626157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.627327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:03.627653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.629337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42228a6c-250d-4ab5-b9aa-8fcd3739897c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.637744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5a725-e602-45a5-966e-a767dba65d51 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.645108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 373/730] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.645108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137002f-47f2-4e82-b43f-be4c58bc8949 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.645108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137002f-47f2-4e82-b43f-be4c58bc8949 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.645108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137002f-47f2-4e82-b43f-be4c58bc8949 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.646156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 374/731] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:03.646856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137002f-47f2-4e82-b43f-be4c58bc8949 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.685074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.686170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.686874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.687319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.688293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:03.688748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.690354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d8126-1ed4-4ea1-9aa5-b8a9e8d7df9f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.717151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 358/732] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:03.719023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcee51-ca4b-4ac5-ab55-f49f9685022f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.719307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcee51-ca4b-4ac5-ab55-f49f9685022f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.719575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcee51-ca4b-4ac5-ab55-f49f9685022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.737767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dcfcee51-ca4b-4ac5-ab55-f49f9685022f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:03.739010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dcfcee51-ca4b-4ac5-ab55-f49f9685022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:03.755740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.771024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137002f-47f2-4e82-b43f-be4c58bc8949 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.819757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.820405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.820683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.820988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.825923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 359/733] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:03.827458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686c45-bd72-4932-88c5-01db88150984 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.827892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686c45-bd72-4932-88c5-01db88150984 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.828306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c686c45-bd72-4932-88c5-01db88150984 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.830554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 360/734] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:03.831597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c686c45-bd72-4932-88c5-01db88150984 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.837704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:03.839734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-40c95647-833a-4ead-8fbe-ff18c3372502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:03.854661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:03.856104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:03.857086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:03.857086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:03.857086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:03.857086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:03.857086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 375/735] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:03.857449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.857736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.858009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:03.865078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:03.878871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:03.880426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:03.955050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c686c45-bd72-4932-88c5-01db88150984 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:03.958804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 376/736] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:03.970079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:03.991897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:03.992628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:03.992932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:03.993207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.014090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.071223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.072680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.093125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd466bb-0692-4e92-bc15-77e9c93fbde5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.124483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.131160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.131785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.132066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.132338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.133058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.134434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.151958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 377/737] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:03 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:04.152908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.196644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 361/738] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 10:13:04.198144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.262881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.286993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a85c45-9f60-4ad8-a440-368fac05eeab None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.327717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec791e72-3bee-4037-8425-86834abfd390 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.330182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.331758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.332035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.332307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.333073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:04.333377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.334848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b871c-3b83-45bd-91e3-d803cbf597f1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.349443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 378/739] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.350697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93442fc-9ee3-4e26-addf-bc30462f3c5a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.350987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93442fc-9ee3-4e26-addf-bc30462f3c5a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.351325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93442fc-9ee3-4e26-addf-bc30462f3c5a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.356864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 379/740] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:04.356864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93442fc-9ee3-4e26-addf-bc30462f3c5a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.377852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.378674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.378955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.379228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.390188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:04.395137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:04.396126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 362/741] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:04.402123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.411880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.471840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93442fc-9ee3-4e26-addf-bc30462f3c5a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.506228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6081c4-df2f-49d3-9fd4-adecc1315531 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.509982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.510632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.510913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.511235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.518783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.524558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.526189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-2cf1174a-12fa-40d3-bffc-99760f853d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:04.541872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:04.542991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:04.544779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:04.544779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:04.544779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:04.544779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:04.548241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 380/742] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:04.548573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.549329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.549564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.549663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.549852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.549949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.550130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.557623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.559094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.569468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:04.570676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:04.570939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:04.571864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:04.572806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:04.576968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 363/743] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:04.577855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.643177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 381/744] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:04 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 10:13:04.643769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.675593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.691923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2534a-f7c5-4659-b1a9-9f3db0ec9bb3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.729718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.730350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.731443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.731727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.732467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:04.732772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.734204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.742731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 364/745] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.743564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.761041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39090eb8-d94f-4d6f-9633-c0b9f19e7145 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.794562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.802502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.803133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.803415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.803689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.804804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:04.805156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.806903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.824486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 382/746] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.824486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.873732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c61e3-29c7-43d0-b645-3037a13c7256 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.909996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.910623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.910843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.911115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.911911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:04.912217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.913689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.925071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:04.937404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 365/747] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:04.937404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:04.940252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d289f15-f83b-4202-8949-3d3415e5b2fb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:04.978787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:04.979420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:04.979702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:04.979980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:04.981011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:04.982381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:04.997565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 383/748] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:04 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:04.998395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.058026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.071218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9d18d-695c-4518-b075-a66af822aa6c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.121057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.121776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.122057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.122329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.137994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38fa72-0e89-4a84-9723-f723fe127bb7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.138205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.139656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:05.165040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:05.166028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:05.166934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:05.166934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:05.166934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:05.166934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:05.166934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 366/749] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:05.167694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.184817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421a94-03af-4989-a753-050a0240d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.185904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421a94-03af-4989-a753-050a0240d92b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.186469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421a94-03af-4989-a753-050a0240d92b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.186946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db421a94-03af-4989-a753-050a0240d92b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.194961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421a94-03af-4989-a753-050a0240d92b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.196895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db421a94-03af-4989-a753-050a0240d92b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-db421a94-03af-4989-a753-050a0240d92b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:05.211062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:05.212031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 384/750] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:05.213491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421a94-03af-4989-a753-050a0240d92b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.228480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.306713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2754f49-bc13-40d6-8ed4-5851d1810106 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.344708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.345709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.346215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.346667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.346847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db421a94-03af-4989-a753-050a0240d92b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.381244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.393198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.393760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.394056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.394353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.395054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:05.395359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.397273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.416537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 385/751] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:05.417689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.437065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.438958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.501334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.535847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fbf0-8429-4bcc-a097-0554ce661e66 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.570275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 367/752] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:05.571455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.577692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.578615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.579062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.579483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.580389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:05.580870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.582531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.600502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 386/753] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:05.601696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.624075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.710887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c0975-0d73-47e8-b2ed-f5a054bca6c5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.719738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3171-69d5-4548-9790-900659d64f79 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.753015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.758766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.759420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.759700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.759972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.765755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.766407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.766688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.766960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.771276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.773010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:05.786751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:05.788064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:05.789081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:05.791937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 368/754] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:05.793821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.903215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.904705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.913924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:05.919618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bab1b7-1f09-4328-90d7-3aeb6f151381 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:05.922062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:05.922984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:05.923885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:05.923885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:05.923885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:05.923885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:05.927917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 387/755] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:05.928881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:05.972683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:05.973694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:05.974196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:05.974664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:05.976253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=7005963bb5b241c2b24a3fe6eab876dd) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:05.976779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:05.978902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:05.997348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 369/756] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/role_assignments?user.id=7005963bb5b241c2b24a3fe6eab876dd&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:05.998379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.083032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23c363-5882-4c8b-9cf2-a5767b93fe02 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.141945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.143085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.147004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.147579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.148637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:06.149175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.150840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.197150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 388/757] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:06.202006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.234674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2d878-0b23-443b-9f13-51dc2d6e8666 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.261580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.290273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.291164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.291498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.291774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.292473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:06.292776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.294908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7efcf-472d-4317-a72a-2f272612cfae None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.311959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 370/758] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:06.313471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398fb0-a921-4b90-8776-08784a5f5bfe None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.313764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398fb0-a921-4b90-8776-08784a5f5bfe None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.314100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41398fb0-a921-4b90-8776-08784a5f5bfe None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.319556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 371/759] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:06.320374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398fb0-a921-4b90-8776-08784a5f5bfe None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.336879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90059a-845e-4087-8e82-75e5d5e4de9e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.354557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.390091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.390762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.391310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.391596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.406400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.409065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-73bc7176-6546-4c6d-a76e-c37d84f1220c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:06.428772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:06.429762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:06.430673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:06.430673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:06.430673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:06.430673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:06.430895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 389/760] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:06.432281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.432461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.432619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.446647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41398fb0-a921-4b90-8776-08784a5f5bfe None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.457802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:06.459212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:06.492467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.493110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.493393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.493668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.501936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.503420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:06.516122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:06.518235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:06.520359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:06.529140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 372/761] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:06.529140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.540971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 390/762] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:06.541970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.591761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.622178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.633212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade0d66-6d75-41b3-8684-ee58fb1cf348 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.681694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.682732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.683578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.684498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.685608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:06.685987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.687029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2290bba-9569-41ac-b086-45886ef48d63 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.687529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.708084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 373/763] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:06.709103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.732766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.733589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.733934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.734277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.735106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:06.735480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.737269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.756826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 391/764] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:06.757879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.831419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f27efc-5efe-474f-a914-7539086158f1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.858377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.868689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.869429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.869717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.869992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.870629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.872157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.881235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db35b9-c1bf-47ce-bad7-c14666446370 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:06.881636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:06.882770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:06.883746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:06.887820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 374/765] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:06.888700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:06.906504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:06.925073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:06.926057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:06.926586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:06.927005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:06.934776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:06.936727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:06.949470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:06.950594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:06.951647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:06.958854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 392/766] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:06.960064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.006314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e48b9-5597-4a1d-a8c6-5ddfedb9024a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.042536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.043850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.044138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.044413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.045224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=014510743ad14e7f9bd781a04d7890e8) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:07.045848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.046975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.060468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 375/767] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/role_assignments?user.id=014510743ad14e7f9bd781a04d7890e8&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:07.060468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.094413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286cd85-a8a8-42e4-b59b-806439aae56a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.131571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.177367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.178007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.178288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.178563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.179262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:07.179569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.181003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29aea1b-58ac-4166-9640-3bf9b8dfe01e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.184216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb08166-c684-4b80-a5f1-d3136ce83d23 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.190732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 393/768] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 10:13:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:07.192499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322e05-1024-4704-abe3-4277d02e31f6 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.192970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322e05-1024-4704-abe3-4277d02e31f6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.193445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322e05-1024-4704-abe3-4277d02e31f6 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.196388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 394/769] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:07.197540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5322e05-1024-4704-abe3-4277d02e31f6 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.221555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.236557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.237940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.238983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.239756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.241113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:07.242164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.244683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ddb84-b649-4492-9341-af05f65246b5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.265327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 376/770] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:07.268097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.268696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.269502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.294542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:07.296123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:07.338567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5322e05-1024-4704-abe3-4277d02e31f6 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.384243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.385098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.385476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.385757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.386473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:07.387322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.387633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 377/771] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:07.388509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.388755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.405780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 395/772] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:07.412490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.473821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.492560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.524727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9d46d-c9f4-42a9-acc8-4aede91d98f5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.529129 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8a310-cffe-4d1f-a917-850677f2441d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.565636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.565829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.566386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.566499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.566716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.566816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.567051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/038cbaf398214c2cbca2383eb8fa7fa5/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.567154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.567945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] RBAC: Adding query filter params (interface=public, service_id=0aebf7c7f2f7404e99fcb889a8437fcc, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:07.568329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.569261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=038cbaf398214c2cbca2383eb8fa7fa5, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.569956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.570814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.579489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 396/773] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/endpoints?service_id=0aebf7c7f2f7404e99fcb889a8437fcc&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:07.580555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.596333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 378/774] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:07 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/038cbaf398214c2cbca2383eb8fa7fa5/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:07.597356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:07.722556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de815aa0-ca7a-40bc-82af-aeebdb63c97c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.749050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.763431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eab4a-4508-4b78-8d01-af5f83d9f3c2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:07.766071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.766723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.767011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.767290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.767968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.769459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.780986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 379/775] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:07.833679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:07.834781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:07.835269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:07.835748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:07.836657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:07.838347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:07.846962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:07.857718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:07.858804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:07.859652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:07.862854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 397/776] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/services/network => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:07.874279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.009871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2230ae2-76f6-47d6-a8c6-b0fc0347dae5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.053346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.054315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.054598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.055281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] RBAC: Adding query filter params (name=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.055591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.057024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.062449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 380/777] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.073987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.212746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970de2-daac-4268-819b-e6ce4ade81c1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.258442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.259083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.259365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.259641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.260336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.260640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.262623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750682e-4e2e-4a33-8719-07eaf73991fa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.268521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 398/778] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.274380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.288325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2f346-3935-4edb-9c04-65059a091c7c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.288640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2f346-3935-4edb-9c04-65059a091c7c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.290417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2f346-3935-4edb-9c04-65059a091c7c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.291724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 399/779] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:08.298918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.299208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.299485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.318449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:08.319666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:08.363848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.397547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.406459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 400/780] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:08.446271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.518981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffea9c-b53f-4fbe-bba1-f78b3cef9404 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.576957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59b2b6-906c-419a-ae26-891626889c14 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.616534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.617271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.617549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.617819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.630044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:08.635130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:08.636113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:08.637986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 401/781] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:08.645655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.666189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.667187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.667696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.668724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.669724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] RBAC: Adding query filter params (interface=public, service_id=8ed6c9bc7c01402586c23c7fb71e9838, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.670241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.671827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.693101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 381/782] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/endpoints?service_id=8ed6c9bc7c01402586c23c7fb71e9838&interface=public®ion_id=RegionOne => generated 194 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:08.698281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.725238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.767792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d943e6-52df-49ce-a00e-06f570df9602 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.804594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.805121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.805400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.805670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.806399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:08.806686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.808063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:08.820379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 402/783] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:08.832895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:08.935340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ccb08-ceb8-40d9-b0e0-2458525d9e33 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.950039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:08.957606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7936-8e1a-4430-aeba-e40bedf1f9c0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:08.977244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:08.977244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:08.977244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:08.977244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:08.983212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:08.984682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.001372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:09.001568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:09.002430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:09.003942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:09.003942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:09.003942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:09.003942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:09.003942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 403/784] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:09.009940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.038738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.039406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.039690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.039963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.040628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.042843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.052823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 382/785] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:08 2022] GET /identity/v3/services => generated 772 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:09.199000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222cd18-1776-4392-a07f-054c9357c5be None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.257685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.258347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.258637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.258917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.259652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:09.259962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.261491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.275948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 404/786] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.282302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.400610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bbf9f-88fd-4fc5-83be-8f5458b925fd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.439952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.440609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.441401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.441401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.451296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.452734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6bc9476e-0976-4ee6-8ef1-19bf21dcdea0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:09.466001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:09.467377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:09.469016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 383/787] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:09.473246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.504230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.591889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f10f-41c8-4566-b0d1-fa7a09a71860 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.592221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f10f-41c8-4566-b0d1-fa7a09a71860 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.592439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f10f-41c8-4566-b0d1-fa7a09a71860 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.593933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 384/788] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:09.609470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.609815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.610033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.629545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc69e77-72ef-41b3-a3b4-a241f05675b7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.642324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:09.643878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:09.691276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.705281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:09.705839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:09.706124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:09.706399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:09.707219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:09.707530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:09.709012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:09.745432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 405/789] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:09.753358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.769256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 385/790] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:09.816631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:09.901139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:09.938107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b458b16-b553-41a2-a434-f70265ec2106 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:09.963316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fcb38f-a0b5-49d6-a87a-f17d2cc8e767 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.000155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.000817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.001151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.001407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.013357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:10.018583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:10.019559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:10.020423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 386/791] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:10.026892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.038019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.038692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.039085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.039370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.056868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.066985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.068462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e82cf1ea-ea39-4ca0-981d-92d4fa9c171c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:10.098119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:10.100342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:10.101638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:10.101638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:10.101638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:10.101638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:10.101638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 406/792] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:10.106065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f4fe-5e80-476d-aa4b-8bd2f6188d79 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.106354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f4fe-5e80-476d-aa4b-8bd2f6188d79 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.106635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91f4fe-5e80-476d-aa4b-8bd2f6188d79 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.108333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 407/793] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:10.109446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f4fe-5e80-476d-aa4b-8bd2f6188d79 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.157292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec8544-1ddf-43fd-92de-927e18d2a10f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.196086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.197106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.197597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.198079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.199035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:10.199602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.201345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f2619-d0d8-460e-84e2-6431c8515600 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.215395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 387/794] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:10.217158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.217667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.218177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.237526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:10.239054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91f4fe-5e80-476d-aa4b-8bd2f6188d79 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.239303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:10.278532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.279322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.279920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.280271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.282145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:10.282534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.284052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.286878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.302156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 408/795] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.303467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.323777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 388/796] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:10.325197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.353579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.439209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded49cde-908c-47a3-af0e-14deaa66effa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.461077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30e0b4-8eaf-4dec-9696-371cd3441c17 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.476210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.477184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.477184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.477403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.488412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.489881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.498760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.499418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.499694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.499966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:10.505969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:10.507050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:10.508179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:10.508179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:10.508179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:10.508179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:10.508455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.508455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.510012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 409/797] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:10.510998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-be272090-27a7-45f1-8044-e06fe93872aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:10.526266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:10.527765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 389/798] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:10.529621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292263c2-62aa-449d-8080-be75dd3f8aef None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.530187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292263c2-62aa-449d-8080-be75dd3f8aef None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.530187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292263c2-62aa-449d-8080-be75dd3f8aef None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.531504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 390/799] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:10.532047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292263c2-62aa-449d-8080-be75dd3f8aef None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.571217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.621096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.627501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb31808-53cf-4e10-a5be-e94771c5ad6f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.645679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292263c2-62aa-449d-8080-be75dd3f8aef None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.663911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.665060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.665612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.665891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.680824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:10.686343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:10.687052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:10.687974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:10.689544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:10.690212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.690212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.690212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.690212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:10.690459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 410/800] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:10.690558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.690628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.690697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e163f-6f30-4ab1-bcdd-11e0d080ed28 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.706596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 391/801] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.707935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.708222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.708496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.728692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:10.729835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:10.804893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 392/802] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:10.804893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.814329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22ee7-0e88-4fb8-9aef-706a4ce5f439 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.824858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.856435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.858385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.858934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.859468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.860436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:10.861018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.862664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.876146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 411/803] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.878442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.893209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:10.928111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93e8e-fee8-4e26-b135-d6f46b2c4550 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:10.968615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:10.969278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:10.969655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:10.969799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:10.970509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:10.970807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:10.972169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:10.982225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 393/804] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:10.987245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:10.992573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff9a7-7ab8-4f88-984e-6cecf9af9dd6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.030777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.031648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.032326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.032326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.040044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.041645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:11.053476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:11.054673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:11.055868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:11.062225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 412/805] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:11.062225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.093809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.101663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18295f2-a6aa-4b76-b4be-14cb539a1dcc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.132674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.139944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.140626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.140966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.141246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.141876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.143259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:11.153158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:11.154156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:11.155009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 394/806] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Jul 26 10:13:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:11.156521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.183433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d3176-96f0-4ccd-98e4-81e295de909b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.221770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.222511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.222786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.223108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/7005963bb5b241c2b24a3fe6eab876dd/roles/2b446efbd008435f977d0068496eb403` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.225110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=7005963bb5b241c2b24a3fe6eab876dd, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.226596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.242767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 413/807] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:11 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/7005963bb5b241c2b24a3fe6eab876dd/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:11.243975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.271144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ddf05-6ecc-4114-b5db-87b1613e783a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.316061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.317073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.317526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.317949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.331181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.333054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:11.350731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:11.351949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:11.353155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:11.353155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:11.353155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:11.353155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:11.353978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 395/808] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:11.355118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.377500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.397643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13135048-4020-4fea-b809-ef9a23d5f510 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.414678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.447072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.447711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.447995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.448271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.449177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:11.449491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.450948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.472058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 414/809] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:11.473058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.478300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2fb9e-4f7c-4524-aa2c-9abd15d28c3d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.514174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.514733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.515009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.515283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.515965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:11.516265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.517676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.523711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 396/810] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:11.525576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.592981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf70ec9-049d-4189-8ea6-447f9e391396 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.633047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.633832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.634113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.634406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.635180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:11.635487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.637408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.641631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561daa6-ce5b-4721-99c0-251a93bac67e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.649649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 415/811] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:11.650566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.656534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.661014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.682033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.682748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.683031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.683369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.696935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.698415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-41101d6a-0946-4e7a-8bbc-077903579586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:11.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:11.716248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:11.717668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:11.717668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:11.717668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:11.717668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:11.717668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 397/812] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:11.718126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afa02c-aa73-4396-a5e6-5622bbe2ced9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.718329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afa02c-aa73-4396-a5e6-5622bbe2ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.718604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afa02c-aa73-4396-a5e6-5622bbe2ced9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.720001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 398/813] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:11.720591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afa02c-aa73-4396-a5e6-5622bbe2ced9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.773364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b41e3-3e25-4d62-ad55-a247d776d331 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.813015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.813663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.814016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.814220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.814932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:11.815357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.816793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.828052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 416/814] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:11.828052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:11.835224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1afa02c-aa73-4396-a5e6-5622bbe2ced9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.870225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.870934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.871251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.871521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.879422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.880898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c4cacfb6-65e9-46ce-90dd-91c0e8a79581 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:11.892991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:11.894173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:11.895148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 399/815] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:11.895794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.896117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.896395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.907816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.916289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:11.917753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:11.935160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:11.943597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47be95-359b-422e-8712-3565c7eb8ad6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:11.982805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:11.983430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:11.983707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:11.983978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:11.984669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:11.985003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:11.986358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:11.998525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 417/816] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:11.999336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.008896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 400/817] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:12.008896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.109493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6d424-faa3-4d0f-a771-5fe7c300bcaf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.122373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766d326-ed7c-4bf9-9b11-f4f9429ba319 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.142423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.149060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.149691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.149970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.150242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.150954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.152352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.160197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.160823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.161139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.161420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.162216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:12.162526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.164064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.184881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 418/818] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:12.184881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.185174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 401/819] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.185174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.214984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.327039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7348421-353c-4431-96e4-7bd36edbc54b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.361652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57be468-45ea-4d7b-998d-7c2991c501d7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.370489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.371762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.372043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.372308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.381241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.382353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:12.396114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:12.397188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 419/820] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:12.398130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.417257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.418277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.418709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.419136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] PATH_INFO: `/v3/services/network` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.419811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.421288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:12.433417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:12.434549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:12.435414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 402/821] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:12.436221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.469111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.533105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.539012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a3fc6-eba4-46c2-a82d-d2d684cfd6f9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.559273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9385ca7-b29e-48b4-8831-4b6be54c903f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.578175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.579089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.579535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.579959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.595944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.596736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.597124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.597487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.598361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:12.598723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.600242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.618532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 403/822] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.619427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.659292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.661475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.707987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.721519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678910b-6829-4eda-8d4c-24e9a7384f76 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.756631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.757447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.757823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.758222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.758987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] RBAC: Adding query filter params (name=network) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:12.759397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.760881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.762791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:12.772879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 404/823] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.772879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.786802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 420/824] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:12.788877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.897643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4b4dd-dece-424c-b3c3-fbfa77a5d155 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.925317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ffc39-bff9-4dfb-835c-cc4ba8af6336 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:12.934495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.935177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.935458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.935732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/014510743ad14e7f9bd781a04d7890e8/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.953436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=014510743ad14e7f9bd781a04d7890e8, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.954915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.967882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:12.969045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:12.969545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:12.970038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:12.976872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] RBAC: Adding query filter params (type=network) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:12.977066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 405/825] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:12 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/014510743ad14e7f9bd781a04d7890e8/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:12.977066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:12.977205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:12.977205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:12.987942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 421/826] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:12.994052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.016409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.107495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.178442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf852-6c72-474e-ac1b-5ced13b80d47 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.196277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27d4f1-95a2-4923-85ec-4439e70d9fe4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.223668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.224302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.224735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.225058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.225778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.227841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.239689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.240682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.241194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.241721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.254572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.255335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 422/827] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:13.256900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-ec2cf493-98fc-42e2-9b88-eca243bb590f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:13.281643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:13.282692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:13.283630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:13.283630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:13.283630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:13.283630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:13.283630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 406/828] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:13.290084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.373155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.385862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4079-2d03-45f4-8c0b-5fd80da13c9a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.386275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4079-2d03-45f4-8c0b-5fd80da13c9a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.386632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef4079-2d03-45f4-8c0b-5fd80da13c9a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.388047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 407/829] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:13.398773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.399414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.399917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.435140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:13.436293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:13.481755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a8e21-5dcc-4eea-882d-44a1029cbeb9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.541127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.541411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.542219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.543613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:13.543922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.545636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.560762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 423/830] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:13.566227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.584262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 408/831] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:13.612969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.658270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.701147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8cb48-a95b-4835-8f26-201c97d924f3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.720780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.737168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99297d9-2c2a-48f0-a77c-c3b2c10c6fc7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.740263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.741241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.741668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.742099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.749783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.751424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:13.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:13.764562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:13.765584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:13.767857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 424/832] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:13.776590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.776744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.776744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.776744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.776744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.787161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:13.792139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:13.793811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:13.794703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:13.798848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 409/833] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:13.800130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.885922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb019f9-4bb3-49c5-aaf2-704c7d18e721 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.894308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:13.904722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad14f4d-8741-4054-90fb-27a67af61a94 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:13.927254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.928233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.928739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.929230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.930168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:13.930748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.932475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.942461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:13.943079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:13.943358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:13.943624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:13.944331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:13.944634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:13.948067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:13.959578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 425/835] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:13.959735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 410/835] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:13.960528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:13.962854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.007004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.064882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705b338-ddf9-45b3-a71e-4826cda2c3be None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.082935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ee8d-c45a-444b-b45e-3f54cf049512 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.100369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.101034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.101314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.101589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.102374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=038cbaf398214c2cbca2383eb8fa7fa5) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:14.102681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.104111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.116874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 411/836] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/role_assignments?user.id=038cbaf398214c2cbca2383eb8fa7fa5&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:14.130842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.131508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.131789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.132127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.144764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.146289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:14.164528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:14.165564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:14.166493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:14.166493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:14.166493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:14.166493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:14.166493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 426/837] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:14.174424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.201323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.298024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840942-ccb4-4eb7-8bc3-fd1e5e950ba5 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.339662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.340293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.340573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.340871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.341554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:14.341857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.343229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216465d-b601-4ca2-9d29-94785e3df65a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.356694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 412/838] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:14.362449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.455111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa69b-474e-4dc7-b38c-e148a6ee0262 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.455469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa69b-474e-4dc7-b38c-e148a6ee0262 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.455663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa69b-474e-4dc7-b38c-e148a6ee0262 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.458398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 413/839] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:14.462893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.463166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.463442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.470740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.485216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec9ef3-c119-4444-9cc6-3c05bca29582 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.485601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:14.486980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:14.533483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.534158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.534442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.534714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.547263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.549286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:14.567399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:14.569010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:14.570372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 427/840] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:14.577088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 414/841] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:14.578927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.600702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.616018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.699564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5c716-ee73-4349-b836-2fed465d22f4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.738094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.739111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.739111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.739583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.740478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:14.740933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.742457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.774792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 428/842] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:14.781051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.783099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39d563-cb67-4a90-8e1f-9aa1bf7eed64 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.793485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.826189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.827148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.827620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.828146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.829414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:14.831992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:14.843048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:14.844752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:14.846367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:14.850018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 415/843] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:14.856907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:14.921694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c2e57a-04f0-42fd-8f38-8999d9eccd64 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:14.951778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:14.961616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:14.962254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:14.962540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:14.962814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:14.991220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dae8ee-e390-4a6a-b26f-e373df326fd1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.028723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.030180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.030706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.031179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.032060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.032572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.034433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.045605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 416/844] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.047437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.048280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.049825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.062534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.176898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 429/845] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:15.180187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.190825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd5bfe-0b59-4e65-aba2-1b3c04ef527a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.229063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.230081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.231146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.231418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.232106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.232404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.233817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb89b7-ee3b-43c9-9e64-e6161c39e772 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.235497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.245058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 417/846] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.246628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc588-d3dc-4e80-9940-6d0c1cc9efbe None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.247694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc588-d3dc-4e80-9940-6d0c1cc9efbe None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.247988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdc588-d3dc-4e80-9940-6d0c1cc9efbe None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.253046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 418/847] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:15.256944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.257232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.257512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.281293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:15.282839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:15.326273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f6cec-f806-4897-a29e-cd5c9f9597ed None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.341054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.367238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 419/848] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:15.384437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.385514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.385979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.386467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.393944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.403943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.405523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:15.424289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:15.425553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:15.426622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:15.426622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:15.426622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:15.426622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:15.426622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 430/849] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:15.432267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.567350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4a89-a89d-43d2-a14d-fed5584eaed2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.576184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f25a4-f35e-4f72-b227-119ab4e1e625 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.609284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.609914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.610190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.610459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.611252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.611581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.611856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.614000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.621632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.622291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.622572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.622848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.640413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:15.640726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 431/850] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:15.642276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:15.643805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:15.644758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:15.645912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 420/851] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:15.651145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.673118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.769544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991fecd-2a18-4084-9715-5a34cd2460d8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.772039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e210e9a-d5ee-4f3f-8b4e-95fb216d4ed1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.809086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.809719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.810003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.810280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.810970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.811092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:15.811293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.812131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.812611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.812714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.813210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.821359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.823210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:15.828893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 421/852] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:15.829865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:15.838122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:15.839121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:15.840099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:15.847290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 432/853] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:15.849076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:15.883130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.937185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed0281-93d2-41a9-a898-caee8698476e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.945164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:15.972259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e1be5-09dd-4a9c-a70c-7818921953a9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:15.974100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:15.974777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:15.975036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:15.975314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:15.987194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:15.988729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:16.004710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:16.005964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:16.007248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:16.007248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:16.007248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:16.007248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:16.010692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 422/854] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:16.012306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.018976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.019967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.020453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.020905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.021819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:16.022293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.024017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.044652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 433/855] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:16.046262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.122665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca550-3353-4858-b931-99984f2fcc38 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.124246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.156957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1addf-3a46-4368-aca3-9a58e6c00250 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.162505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.163372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.163807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.164238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.165127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:16.165596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.167183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.185008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 423/856] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:16.186263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.195047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.195707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.195991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.196263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.197088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=7005963bb5b241c2b24a3fe6eab876dd) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:16.197395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.198896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cad09-d576-4845-a59e-3b4a70d031e9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.213027 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 434/857] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/role_assignments?user.id=7005963bb5b241c2b24a3fe6eab876dd&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:16.310526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93371ab8-f10d-41e2-944f-e2506280ad03 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.352345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.353364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.353814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.354270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.361190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f458ec-c6e8-4171-a3a0-4344cb8d9eb7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.361623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f458ec-c6e8-4171-a3a0-4344cb8d9eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.361993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f458ec-c6e8-4171-a3a0-4344cb8d9eb7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.363754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 435/858] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:16.364161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.365820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.370378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.370788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.371196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:16.379564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:16.380589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:16.381952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:16.382657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.382754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 424/859] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:16.387178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.396353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:16.397729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:16.415389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.487586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 436/860] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:16.509775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.522844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc83c41-cbb6-4c64-aabf-d3c566c1f8a4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.568904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.569479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.569761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.570096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.570902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:16.571262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.572857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.594247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 425/861] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:16.600972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.629931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe72965-33e0-499e-8e32-76c46545e656 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.668754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.669656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.669968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.670244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.670882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.672246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.674457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:16.683090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:16.684891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:16.685867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:16.690807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 437/862] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:16.691902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.718413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.743358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd040d7-22fa-44ab-85c8-728d4c31399a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.788517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.789790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.790252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.790739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.819393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8275c-363f-479a-b38e-93d44bc0c395 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:16.865803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:16.867411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:16.868018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:16.868564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:16.869464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:16.870110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.872890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.880422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 438/863] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:16.885328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:16.885813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:16.887592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:16.961208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:16.985636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.005334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a223be-6293-462a-95cb-6083da80f180 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.012885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 426/864] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:17.014834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.047204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.048111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.048541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.049081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.050010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:17.050459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.052062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.057732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 439/865] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:17.139519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d47f77-c5f2-43df-bfd5-809fda4d451b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.179952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.180891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.181319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.181768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.194328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.196122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8376d7b7-1f8f-4618-9a87-556d7d96811d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:17.213652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:17.214837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:17.215794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:17.215794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:17.215794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:17.215794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:17.217860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 427/866] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:17.225418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.335485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd36c4e-122b-47c2-bb5c-cdf045c1ff16 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.360125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f89dec-ca2a-4b98-8758-d72f71d1019a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.360651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f89dec-ca2a-4b98-8758-d72f71d1019a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.360651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f89dec-ca2a-4b98-8758-d72f71d1019a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.363264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 428/867] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:17.363671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.368134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.368413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.368683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.374574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.375237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.375535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.376008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.377627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:17.377945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.379332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.389256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:17.391083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:17.394139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 440/868] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:17.401870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.428420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.483964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 429/869] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:17.510290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.540749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64bffc-0165-48a9-85e9-dccd26c6738a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.586653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.588457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.588937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.589357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.599266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.601524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:17.622473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:17.623449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:17.624364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:17.624805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c265b-35f0-410d-a92b-7a031239bb22 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.631781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 441/870] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:17.633599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.670943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.671598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.671907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.672182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.672935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.674553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.696940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 430/871] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:17 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:17.707057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.769115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8b8a-5b71-43bc-8221-ad5ede944c5c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.815457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.816148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.816433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.816708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.817507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:17.817818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:17.819299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4deca-c961-40cf-9d1b-f23651e2a3a4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:17.834315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 442/872] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:17.842449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:17.870530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:17.961354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fed82-623e-4a45-9a2b-72a41dad1ed7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:17.997666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:17.998291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:17.998567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:17.998837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:17.999628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=014510743ad14e7f9bd781a04d7890e8) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:17.999934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.001410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c258e-5055-40cc-a2d9-0d1deb03031f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.008240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 431/873] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:17 2022] GET /identity/v3/role_assignments?user.id=014510743ad14e7f9bd781a04d7890e8&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.387756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2614aa-30de-486e-b6de-3bc267d0af11 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.388041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2614aa-30de-486e-b6de-3bc267d0af11 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.388318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2614aa-30de-486e-b6de-3bc267d0af11 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.389949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 443/874] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:18.395207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.395656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.395751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.414347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:18.415547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:18.489002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 432/875] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:18.511037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2614aa-30de-486e-b6de-3bc267d0af11 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.620554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2614aa-30de-486e-b6de-3bc267d0af11 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.622977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.656975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.657874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.658308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.658729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.659515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.661062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:18.671042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:18.672304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:18.673418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:18.675913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 444/876] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:18.681787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.701345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:18.795829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87479ff5-4338-4137-8e6d-bb1702874a1a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.831869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.832486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:18.832762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:18.833061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:18.833732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:18.834029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:18.835428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471de63-f73a-4207-9182-ba10293f271f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:18.841483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 433/877] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:18.847125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:18.957940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ce22b-56ab-4d81-aa9d-3ec2f3a67477 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:18.999349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:18.999985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.000265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.000540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.001262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:19.001569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.002951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0789d4c6-243a-494a-af97-237de801a3fb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.008225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 445/878] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:19.261179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e404fa-325b-4ae6-8b1f-7265c91f32b5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.261617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e404fa-325b-4ae6-8b1f-7265c91f32b5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.262090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e404fa-325b-4ae6-8b1f-7265c91f32b5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.264813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 434/879] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:19.270861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e38282-d6bd-437b-a685-c1e69df4e614 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.271177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e38282-d6bd-437b-a685-c1e69df4e614 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.271420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e38282-d6bd-437b-a685-c1e69df4e614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.292014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-27e38282-d6bd-437b-a685-c1e69df4e614 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:19.294149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-27e38282-d6bd-437b-a685-c1e69df4e614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:19.324364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.377754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 446/880] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:19 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:19.399491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e404fa-325b-4ae6-8b1f-7265c91f32b5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:19.494831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:19.519662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e404fa-325b-4ae6-8b1f-7265c91f32b5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:19.559976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd73844-46fd-43eb-b898-778af521a000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:19.560617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73844-46fd-43eb-b898-778af521a000 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.560936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73844-46fd-43eb-b898-778af521a000 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.561208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd73844-46fd-43eb-b898-778af521a000 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.561925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd73844-46fd-43eb-b898-778af521a000 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:19.563326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd73844-46fd-43eb-b898-778af521a000 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:19.582250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 435/881] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:19 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:19.913210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3897f-1589-4524-a834-2c3516e17fc5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.914236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3897f-1589-4524-a834-2c3516e17fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.914790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3897f-1589-4524-a834-2c3516e17fc5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.916585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 447/882] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:19.922115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541f36a-945e-41a0-a977-2f6b269294bc None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:19.922648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541f36a-945e-41a0-a977-2f6b269294bc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:19.923150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541f36a-945e-41a0-a977-2f6b269294bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:19.941518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c541f36a-945e-41a0-a977-2f6b269294bc None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:19.943048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c541f36a-945e-41a0-a977-2f6b269294bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:20.024927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 436/883] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:20.052670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3897f-1589-4524-a834-2c3516e17fc5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.163618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3897f-1589-4524-a834-2c3516e17fc5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.198064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d4e2-e4e5-4d7e-bc15-0938741d56d6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.198394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d4e2-e4e5-4d7e-bc15-0938741d56d6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.198615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2d4e2-e4e5-4d7e-bc15-0938741d56d6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.200217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 437/884] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:20.203337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.204014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.204292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.204568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.205250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.206721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.208228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.208530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.208815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:20.217176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:20.219805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:20.221893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 448/885] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:20.226328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.237064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:20.238388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:20.254255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.325002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.344463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d17ad8-0de9-4eed-ab1b-115eb6a3c95c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.344951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 438/886] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:20.359508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.389473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.391155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.391669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.392381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.394038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:20.394557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.396394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.403467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 449/887] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:20.409148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.482569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b634-db95-42c6-bcc4-da6aefbed1b7 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.500692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.514898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2a685-d5c1-4f39-b25b-1d9719eee6da None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.521364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.522295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.522782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.523257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.534338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:20.539628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:20.540548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:20.541444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:20.544120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 439/888] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:20.553932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.558067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.560666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.561218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.561713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.562610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:20.563120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.564726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.576025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 450/889] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:20.577378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.628691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.688414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad3da1-3e63-4cc7-a4b5-751696b18577 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.695482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87427307-4b11-4cc3-af8f-26c274c0c483 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.739884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.740431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.740711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.741008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.741775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] RBAC: Adding query filter params (interface=public, service_id=b6611f4d86f84268a98e273ee69679d2, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:20.742077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.743227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.743437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.744045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.744429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.745107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.747043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:20.747455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.749245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.749782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 451/890] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/endpoints?service_id=b6611f4d86f84268a98e273ee69679d2&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:20.757832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.758772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 440/891] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:20.770048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:20.781744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.870663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07435acc-1aea-4f0d-b5e6-6c59c722c61b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.880455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e2a2f-4de7-4292-a865-a9faea79970f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:20.899089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:20.906601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.907232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.907517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.907808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.908466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.909867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.920874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 452/892] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:13:20.929557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:20.930228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:20.930511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:20.930788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:20.947709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:20.947709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-584836e4-9c54-455a-8be5-a0724847b238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:20.967824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:20.968903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:20.969831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:20.969831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:20.969831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:20.969831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:20.969831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 441/893] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:20.976252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.071908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.094463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7140-ab2c-4abb-a170-4f0f7d1c9bce None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.130630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.132746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.132746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.132746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.134760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:21.134760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.134888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.144776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d36a3-c5f0-4026-8d6e-c9e78482ad47 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.145121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d36a3-c5f0-4026-8d6e-c9e78482ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.145355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d36a3-c5f0-4026-8d6e-c9e78482ad47 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.146841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 442/894] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:21.151799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 453/895] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:21.152872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.153239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.153586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.164673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.176765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:21.178095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:21.250404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 443/896] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:21.272256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.291552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a17dc-d9de-439f-9051-bc795acbf552 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.337208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.337869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.338151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.338426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.348393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.350296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.353908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:21.368080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:21.369249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:21.370227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:21.370802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 454/897] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:21.376494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.383661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.391273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579cf2d9-aeb4-435b-b705-d73a424d0498 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.437613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.438800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.439563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.440158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.441861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.443570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.465639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 444/898] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:21 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:21.508265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173c8f6-5173-4fa7-8edf-f810ef866ac2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.555813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.556456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.556737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.557040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.557853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:21.558161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.559697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d17f2-7e54-4e69-99e6-2085cced4801 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.580632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 455/899] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:21.586335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.685038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe606d-0054-412b-a160-fdad8b32ace7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.685345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe606d-0054-412b-a160-fdad8b32ace7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.685541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe606d-0054-412b-a160-fdad8b32ace7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.686884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 456/900] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:21.693910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.693910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.694170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.703664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3413775-74dc-4ff9-a177-ea50435ad2cc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.714311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:21.716183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:21.739657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.740286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.740571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.740871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.771483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.781639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:21.798185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 457/901] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:21.818492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.820127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:21.822536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.937490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 445/902] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:21.939513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:21.956771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d98f3f5-d72e-4a5d-a4c3-79112d5bcd9d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:21.994430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:21.995392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:21.996671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:21.997157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:21.997976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:21.999721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:22.009758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:22.010816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:22.012258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:22.020207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.020564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 458/903] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:22.022510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.068539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b0e4f-0f0b-452f-bd61-a6b5c8b44118 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.076632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.110638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.111295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.111580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.111883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.124558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.126193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.134518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e92b91-f7f8-4bd7-a70b-f261b93e0e05 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:22.143481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:22.144465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:22.145420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:22.145420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:22.145420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:22.145420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:22.149589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 446/904] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:22.150652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.178525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.179568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.180073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.180569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.181514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.182015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.184212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.194899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 459/905] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:22.196188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.275595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4764efe-c560-494e-bc4a-0a195ee3fa32 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.289683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.307974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e05d5-836d-4587-ab8b-2c5b612d6a22 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.316570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.316910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.317169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.317445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.318237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.318571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.320056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.324343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.340157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 447/906] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:22.341243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.350063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.351091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.351588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.352079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.353052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.353558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.355935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.364934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 460/907] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:22.367867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.455555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf011af-f985-4493-a9f9-42b44594d97e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.474356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af18cb-c016-478c-9d26-34e8dab1debc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.496445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.497153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.497434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.497712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.506073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.507539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.514217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.515277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.515836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.516308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.517331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] RBAC: Adding query filter params (interface=public, service_id=fcf8a432e1844a95808fdd685f023e8b, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.517848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.519523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:22.520819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:22.521739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:22.522662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:22.527768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 448/908] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:22.528711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.535295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 461/909] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/endpoints?service_id=fcf8a432e1844a95808fdd685f023e8b&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:22.536729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.566012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.592045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.671798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee3d2b-242a-4083-a426-886ec86f654a None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.675577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11f3b-f223-4ea6-af1e-b9fa76346d6f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.718668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.719785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.720340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.720790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.721810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.722158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.722445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.722726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.722999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.723311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.723663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.725070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.725498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4705f0c-430c-4f3b-b9c9-efa4224d5612 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.733817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 462/910] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:13:22.747220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 449/911] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:22.755359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:22.911984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34770fe-e69b-4dec-b77b-e8e7892de175 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:22.916519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:22.976716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:22.977743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:22.978089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:22.978542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:22.979963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] RBAC: Adding query filter params (role.id=53ae1c37fc3948a89edface7ba76277c, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=014510743ad14e7f9bd781a04d7890e8) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:22.980399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:22.982207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2d0bc-2def-42c4-b7e5-dfa52de93862 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:22.990852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 463/912] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:22 2022] GET /identity/v3/role_assignments?user.id=014510743ad14e7f9bd781a04d7890e8&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=53ae1c37fc3948a89edface7ba76277c => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:23.174866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fd49-ed28-43f1-b1f2-eab765ecacb4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.175244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fd49-ed28-43f1-b1f2-eab765ecacb4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.175423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fd49-ed28-43f1-b1f2-eab765ecacb4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.177080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 450/913] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:23.182761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.183063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.183367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.203471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:23.204697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:23.281959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 464/914] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:23.304700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fd49-ed28-43f1-b1f2-eab765ecacb4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.477312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.496333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fd49-ed28-43f1-b1f2-eab765ecacb4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.560346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.561392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.561879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.562371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.563538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.573020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6396cf9b-a17e-4186-b035-93ac99b98331 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:23.593127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:23.594208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 10:13:23.595091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:23.596471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 451/915] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:23.606534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.622869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357953b4-a6b6-4e76-bd64-abc012c17f6a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.623184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357953b4-a6b6-4e76-bd64-abc012c17f6a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.623431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357953b4-a6b6-4e76-bd64-abc012c17f6a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.626265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 452/916] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:23.630970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.631258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.631540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.653732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:23.655507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:23.756781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 453/917] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:23.776931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.799915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.804381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aaba18-9fe8-4569-8ca2-faf595ac4099 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:23.853827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:23.854471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:23.854749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:23.855546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:23.856515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:23.856830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:23.858283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:23.881235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 465/918] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:23.887514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:23.955439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:23.975995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb48390-e307-4c92-94f0-27294e0dabf8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.024049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.025134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.025700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.026193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.027624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.029282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:24.051712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:24.052828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:24.054030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:24.056937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 454/919] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:24.065923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.079920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e78142-5d46-4766-99c7-7dc725cbb423 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.123086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.124056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.124546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.125141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.126138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:24.126702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.128371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.140114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 466/920] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Jul 26 10:13:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:24.141922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.178874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:24.250229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8becc-0128-4eef-90b4-fda7758250fd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.292496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.293769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.294055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.294329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.295121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:24.295431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.296864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.299278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfdc08-ec88-45fb-9241-e2e3fcb33acc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.303176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 455/921] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:24.311949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.342282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:24.343261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.345145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.345650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.346167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.347364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.349374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.385310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 467/922] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:24.520076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034bfac-bbc8-49e6-9c34-a45576acb938 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.571977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.573035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.573530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.574580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.575481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:24.576072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.577876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.584445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 456/923] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:24.594188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.690777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:24.710275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63243335-ef69-4365-ab3b-ea64638c7ece None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:24.749744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:24.750409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:24.750691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:24.750966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:24.751767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] RBAC: Adding query filter params (interface=public, service_id=269bb72d66974fd89fe99fc1f4f8b9f7, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:24.752078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:24.753542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfebf2-4131-4b5c-9597-8bcfc532cc00 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:24.760125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 468/924] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:24 2022] GET /identity/v3/endpoints?service_id=269bb72d66974fd89fe99fc1f4f8b9f7&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:24.769711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:24.908512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:24.952753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6891f-e577-4007-b7d4-297de3652e64 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.014823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.015768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.016216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.016709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.017996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.018785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0210-0227-4f96-b19e-33d72f5cacc9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.019074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0210-0227-4f96-b19e-33d72f5cacc9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.019348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c0210-0227-4f96-b19e-33d72f5cacc9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.020559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.021001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 469/925] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:25.026224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848beced-9f0e-4d05-9609-24df6f1dba92 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.026619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848beced-9f0e-4d05-9609-24df6f1dba92 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.026940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848beced-9f0e-4d05-9609-24df6f1dba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.038224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 457/926] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:24 2022] GET /identity/v3/services => generated 1497 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:13:25.050351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-848beced-9f0e-4d05-9609-24df6f1dba92 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:25.051755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-848beced-9f0e-4d05-9609-24df6f1dba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:25.130606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 470/927] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:25.154350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.277537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce80ba-f6bd-4fb4-b814-e7ba98203548 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.277925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce80ba-f6bd-4fb4-b814-e7ba98203548 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.278301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce80ba-f6bd-4fb4-b814-e7ba98203548 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.279943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 471/928] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:25.285537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.285824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.286102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.313392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:25.315184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:25.342518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f9adc-5422-4d2d-a5da-5df3c710b216 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.401202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 472/929] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:25.410108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.411209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.411694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.412183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.413316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.416098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.422431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:25.434999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:25.436061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 10:13:25.436964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:25.437770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 458/930] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:25.443907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.447029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.452174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.589893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eeae89-b9dc-498c-9695-0b4acd367e04 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.593279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389a912-13db-4d6f-b0ce-e58c42235d13 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.629162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.629900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.630186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.630602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.631463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:25.631839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.633383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.639300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 459/931] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:25.648818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.655331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.656219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.656686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.657189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.675877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:25.684707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:25.686577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:25.687638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 473/932] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:25.693314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.771184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.783804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:25.825319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1f65-853e-45dc-8846-43459e7089c9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.860159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd5b85-1052-445f-969e-da48808b2576 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:25.887629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.888277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.888560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.888855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.889642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:25.889950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.891493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.903125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 474/933] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:25.908672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:25.930492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:25.932211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:25.933081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:25.933815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:25.936068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:25.936982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:25.940469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:25.957194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 460/934] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:25.964236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.027868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f423-0d3d-4e75-ae2e-0e1618209d27 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.057237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.066400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.067059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.067339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.067613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.082070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.083574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:26.100201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:26.102224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:26.104645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:26.104645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:26.104645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:26.104645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:26.106932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 475/935] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:26.107827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.204942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e244d-2b5f-40d1-9576-f12bf7e6c52a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.224448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff485e-a8ca-4ea2-ac86-7f333a7409b7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.262193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.262836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.263122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.263370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.264324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:26.264670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.265909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.271643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.285323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 476/936] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:26.292032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.292664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.292831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.293028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.293323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.294292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.295718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.332877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 461/937] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:26.377749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.453669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240319c-6bcd-4864-87b3-e64c0a11a298 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.508501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950552f8-0167-4f33-912a-13777aff058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.509093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950552f8-0167-4f33-912a-13777aff058e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.509372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950552f8-0167-4f33-912a-13777aff058e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.509647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950552f8-0167-4f33-912a-13777aff058e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.519809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950552f8-0167-4f33-912a-13777aff058e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.521402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950552f8-0167-4f33-912a-13777aff058e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-950552f8-0167-4f33-912a-13777aff058e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:26.535622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:26.537508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:26.539968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 477/938] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:26.543683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.678834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cb88-2c85-4b59-8706-826ae3301d6b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.719976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.720611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.721012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.721291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.722102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:26.722643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.724119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.747639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 462/939] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:26.753385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950552f8-0167-4f33-912a-13777aff058e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:26.865109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:26.872240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950552f8-0167-4f33-912a-13777aff058e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:26.911001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:26.911666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:26.911947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:26.912244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:26.926260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:26.927753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-29325d7c-f76f-466e-9272-7c3899471ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:26.945343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:26.946743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:26.947794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:26.947794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:26.947794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:26.947794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:26.947794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 478/940] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:26.954518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.016738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.104636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c4ec5-886b-46b7-a804-fdf727dad558 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.110788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f1475-264e-4b42-a696-619a8343fe40 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.111160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f1475-264e-4b42-a696-619a8343fe40 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.111456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f1475-264e-4b42-a696-619a8343fe40 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.113078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 479/941] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:27.120453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.120965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.121193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.141134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:27.142564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:27.144360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.145238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.145676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.146112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.146825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:27.147135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:27.148542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:27.163462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 463/942] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:27.170875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.246725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 480/943] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:27.271048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.316521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5211c51-9f3e-4eda-8c2b-5df87fc6e96f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.321144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.363300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.364408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.364952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.365505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.375405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:27.377535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:27.384394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:27.398701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:27.399901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:27.401036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:27.404576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 464/944] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:27.412064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.420275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c700a4d-68d2-444c-8c27-39cac5c7e81b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.465716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.466762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.467253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.468250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.469144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:27.471887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:27.476725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING keystone.server.flask.common [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 10:13:27.505153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.sql.core [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 10:13:27.505153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 10:13:27.505153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [parameters: {'id': 'c4bb3356285c4b3cb01b4bc93c9ef750', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 10:13:27.505153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4bb3356285c4b3cb01b4bc93c9ef750.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4bb3356285c4b3cb01b4bc93c9ef750. Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:13:27.536676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 10:13:27.537632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application yield resource Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise self.value Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application session.commit() Jul 26 10:13:27.538641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.session.flush() Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application compat.raise_( Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 10:13:27.539547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 10:13:27.540454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application result.read() Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:13:27.541299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [parameters: {'id': 'c4bb3356285c4b3cb01b4bc93c9ef750', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.542295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:27.543250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4bb3356285c4b3cb01b4bc93c9ef750. Jul 26 10:13:27.544224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.546652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 481/945] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Jul 26 10:13:27 2022] POST /identity/v3/projects => generated 262 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:27.549651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.566164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233aff9d-c019-4e63-a9b4-42d446a34ce7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.612328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.613544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.614421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.615227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.616400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:27.617158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:27.619199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:27.647581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 465/946] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:27.648175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.685786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.718411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b51164-e97b-4887-bd8b-36c8f56cc46e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.771225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.772168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.772583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.773025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.776140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:27.783373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf57e51-6566-4ae3-8c97-1b6ba3494412 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:27.784508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:27.788196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6124dd93-d08a-4678-b2ab-6a44bc6bd72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:27.808790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:27.809832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 482/947] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45916-0ebf-4a97-8897-a0eb3a460dc7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.816133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45916-0ebf-4a97-8897-a0eb3a460dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.816785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45916-0ebf-4a97-8897-a0eb3a460dc7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.818402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 483/948] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:27.819214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f45916-0ebf-4a97-8897-a0eb3a460dc7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:27.844818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e089f-7589-47b2-a45d-8f73858523e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:27.846510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e089f-7589-47b2-a45d-8f73858523e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.847081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e089f-7589-47b2-a45d-8f73858523e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.847559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e089f-7589-47b2-a45d-8f73858523e0 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/014510743ad14e7f9bd781a04d7890e8/roles/53ae1c37fc3948a89edface7ba76277c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.851016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e089f-7589-47b2-a45d-8f73858523e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=014510743ad14e7f9bd781a04d7890e8, role_id=53ae1c37fc3948a89edface7ba76277c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:27.853624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e089f-7589-47b2-a45d-8f73858523e0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:27.875018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 466/949] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:27 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/014510743ad14e7f9bd781a04d7890e8/roles/53ae1c37fc3948a89edface7ba76277c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:13:27.877502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:27.877975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:27.878625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:27.939801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:27.939801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:28.004965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f45916-0ebf-4a97-8897-a0eb3a460dc7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.049175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 467/950] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:28.068091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.069188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.069512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.069899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.070695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.071353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:28.071883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.074985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.095507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.114912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 484/951] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:28.263608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf0baa-ab3c-4429-b82f-b0dc7dc3dd9c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.347050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.348146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.348629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.349168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.350592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.353674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:28.375433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:28.376599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:28.377507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:28.378559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 468/952] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:28.388808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.479459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.532457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95843614-26c8-4160-9905-a8208fb26ea5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.576555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.577357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.577750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.578045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.578777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:28.579117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.580686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.586974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 485/953] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:28.596666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.695131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.720502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f0d6d-81db-4ec4-9b3c-4aecc9b89d80 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.758485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:28.759377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.759830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.760253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.761143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:28.762146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:28.763687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c5b29-a7d2-4fe2-bde0-e903e557f09c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:28.769945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 469/954] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:28.778832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:28.943076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2117d40-c47e-4a31-bd4f-20ac3e62a646 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:28.961349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a9dc-a0de-4f14-ade7-cb61ac8ac458 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.961979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a9dc-a0de-4f14-ade7-cb61ac8ac458 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.962459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a9dc-a0de-4f14-ade7-cb61ac8ac458 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.964359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 470/955] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:28.970053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:28.970684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:28.971164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:28.975050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:28.997046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:28.998736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:29.010063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.011695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.012215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.012694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.013660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.015273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.075611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 486/956] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:29.160052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 471/957] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:29.200396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.397359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3eb6d9-4a29-4eb3-b59d-85fda75772fb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.446215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.446891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.447176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.447455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.448103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.449794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:29.463883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:29.466465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:29.468151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 487/958] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:29.476885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.547693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.587761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b56402-a688-4da3-860a-f980db99c1ea None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.631966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.632622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.632940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.633229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.633936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:29.634246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.635673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a2cd4-bc16-439b-b517-98a753939f8a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.642406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 472/959] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:29.649101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:29.728468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:29.837700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21543783-d674-41c0-9163-8d2bd66ea2fb None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:29.905713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:29.907280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:29.908047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:29.908809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:29.910384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:29.911201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:29.914082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369815-4701-49b2-8f83-67050ba82a75 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:29.923670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 488/960] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:30.387454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1ad0-0c4b-419d-8d11-fb055161d4d9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.388298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1ad0-0c4b-419d-8d11-fb055161d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.388298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef1ad0-0c4b-419d-8d11-fb055161d4d9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.389821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 473/961] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:30.396749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.397185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.397436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.420553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:30.422153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:30.513374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 489/962] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:30.541275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1ad0-0c4b-419d-8d11-fb055161d4d9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.669592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef1ad0-0c4b-419d-8d11-fb055161d4d9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.704360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.712332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.712994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.713272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.713544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.714501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.716028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.718996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING keystone.server.flask.common [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 10:13:30.734337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.sql.core [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 10:13:30.734337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 10:13:30.734337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [parameters: {'user_id': '0c9186517bb7467f80b182690dbf293a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 10:13:30.734337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 26 10:13:30.741742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:13:30.742700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application yield resource Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application next(self.gen) Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise self.value Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application session.commit() Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 10:13:30.743692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.session.flush() Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application compat.raise_( Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 10:13:30.744624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 10:13:30.746255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application conn.query(q) Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application result.read() Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 10:13:30.747277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [parameters: {'user_id': '0c9186517bb7467f80b182690dbf293a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:30.748153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 10:13:30.753330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:30.754267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 474/963] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Jul 26 10:13:30 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:30.754709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:30.791159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:30.883913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318b5d-51a0-455a-8c0a-8ee79a6eb315 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:30.926687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:30.927764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:30.928343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:30.928820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:30.937726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:30.939662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-bcbe1d4d-f399-4ea3-9808-3f30c4ba1d2b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:30.953786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:30.956064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:30.958412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 490/964] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:30.964870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.092170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945aedbe-5ca3-4cf0-85fd-478f3b21567d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.107299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b15b-dd5d-4c98-a959-a87d4a33da05 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.107776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b15b-dd5d-4c98-a959-a87d4a33da05 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.108255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3b15b-dd5d-4c98-a959-a87d4a33da05 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.116516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 491/965] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:31.120100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.120600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.121143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.133944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.135568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.135919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.136767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.137616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:31.138067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.139932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.153456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:31.155462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:31.190112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 475/966] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Jul 26 10:13:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:31.293257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 492/967] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:31.332673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.425864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.484996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89cbe5-1f20-4db3-b44b-02e40436c3d6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.530765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.531438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.531721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.531996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.555296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:31.561585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:31.563653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:31.566359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 476/968] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:31.570466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:31.616131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:31.762207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d408f0-e35d-4953-8647-7e7eee498263 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:31.827232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:31.828178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:31.828638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:31.829135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:31.830276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:31.830718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:31.832889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a974074-b257-4044-8bd0-9ec3d21de7a1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:31.856106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 493/969] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:31.858523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.042871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4136-7022-4192-b557-16da29c2a4f0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.043106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4136-7022-4192-b557-16da29c2a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.043413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f4136-7022-4192-b557-16da29c2a4f0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.044984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 494/970] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:32.050708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.051130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.051538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.057457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749dc9eb-cd0b-4c9b-ac96-a1fda318cab6 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.076980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:32.084627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:32.086012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:32.111068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.111802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.112112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.112432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.129848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.132083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:32.153157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:32.154918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:32.155947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:32.155947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:32.155947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:32.155947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:32.155947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 477/971] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:32.160442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.216902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 495/972] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:32.252296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.273354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:32.317597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391cc2b-b0d2-4791-a20e-a16c58e6d095 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.364397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.365191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.365474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.365852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.366562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:32.367712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.368979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.392458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 478/973] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:32.393749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.414049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f6006-c07c-4470-a9d1-54e836b6a87d None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.427096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:32.468001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.469116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.469613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.470104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.471272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.473878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b45f65c8-e089-413e-a913-989183ceb1e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:32.492164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:32.493323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:32.494179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:32.494944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 496/974] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:32.496651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b176fc-5533-45e5-b886-c15653d3dc25 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.497155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b176fc-5533-45e5-b886-c15653d3dc25 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.497618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b176fc-5533-45e5-b886-c15653d3dc25 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.500783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 497/975] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:32.502552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b176fc-5533-45e5-b886-c15653d3dc25 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.530395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65e297-ccd4-4eb6-87e8-cfcbc62d5178 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.570632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.571195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.571455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.571726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.580470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.582999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5f0224cc-0d35-4694-bdb8-78d47c64e0b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:32.600522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:32.602944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 479/976] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.606246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.607900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.627004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:32.627790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:32.629433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:32.654581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b176fc-5533-45e5-b886-c15653d3dc25 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.694656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.695696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.696226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.696612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.697713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:32.698266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.700455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.706460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 498/977] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:32.707439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.716652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 480/978] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:32.717576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.735487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:32.842108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9d23-482d-4e6b-8c30-0a62d8612e45 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.852279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ec6e4-37f2-4397-8654-c79cf9d0bc9a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:32.882087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.882720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.883609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.883609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.884061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:32.884363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.885843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.903103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:32.903869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:32.904228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:32.904671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:32.905296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:32.906860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:32.907415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:32.909227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:32.909411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 499/979] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:32.910364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:32.915456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 481/980] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:32.916405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.019630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.057183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6793aa-f9cc-4028-a3f6-3ff9af503b6b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.067525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c8ce5-c70b-4dd3-b0fe-634fd5fe1137 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.100945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297091-69c3-430a-9814-7e693763827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.101516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297091-69c3-430a-9814-7e693763827c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.101797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297091-69c3-430a-9814-7e693763827c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.102150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d297091-69c3-430a-9814-7e693763827c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.111555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.111896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.112175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.112512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.113211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.114809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.134371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 500/981] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:32 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:33.135812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.216474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.236469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297091-69c3-430a-9814-7e693763827c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.238884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d297091-69c3-430a-9814-7e693763827c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.285601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27653ac1-9c6e-4626-ab8b-d3ae911a079c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.328317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.329003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.329291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.329565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.330358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] RBAC: Adding query filter params (interface=admin, service_id=269bb72d66974fd89fe99fc1f4f8b9f7, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:33.330674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.332093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.338477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 501/982] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/endpoints?service_id=269bb72d66974fd89fe99fc1f4f8b9f7&interface=admin®ion_id=RegionOne => generated 193 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:33.346765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.365144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.408075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 482/983] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:33.414799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297091-69c3-430a-9814-7e693763827c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.519855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e1b9e-53c2-45e6-8e80-52d607a242bc None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.543799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:33.569485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.570667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.571161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.571727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.572571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.575081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.575983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d297091-69c3-430a-9814-7e693763827c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.587540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 502/984] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/services => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:13:33.653127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.654174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.654644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.655140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.677667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.680864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:33.711762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:33.712789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:33.713768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:33.713768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:33.713768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:33.713768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:33.714486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 483/985] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:33.720596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.856967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30d045-75c8-4f71-926d-f9fd3cebc026 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:33.909956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:33.910540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:33.910825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:33.911101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:33.911819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:33.912121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:33.913542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:33.928097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 503/986] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:33.933655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:33.971026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.084001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bb798-4373-47eb-ae75-6d844885a330 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.143033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.144117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.144579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.145068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.156559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.158622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:34.178508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:34.179484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:34.180404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:34.185188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 484/987] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:34.189588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.258194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.343165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4232fac-37a5-4f82-9193-fe7daca867b1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.384188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.384773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.385077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.385347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.386644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:34.386955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.388440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4dad65-8d18-493d-ae58-6b9d88fb3107 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.403542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 504/988] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:34.410257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:34.515196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:34.526308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52721b-2b06-4363-9999-06dd7eb4eca8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:34.563234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:34.563882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:34.564165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:34.564436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:34.565285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] RBAC: Adding query filter params (role.id=53ae1c37fc3948a89edface7ba76277c, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=014510743ad14e7f9bd781a04d7890e8) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:34.565599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:34.567109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60ca16-1434-4cf6-af6b-fad6fa2bbff7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:34.581303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 485/989] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:34 2022] GET /identity/v3/role_assignments?user.id=014510743ad14e7f9bd781a04d7890e8&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=53ae1c37fc3948a89edface7ba76277c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:35.422602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c49b-ba66-46fb-b08d-681af4dc6e90 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.423140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c49b-ba66-46fb-b08d-681af4dc6e90 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.423623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085c49b-ba66-46fb-b08d-681af4dc6e90 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.426189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 505/990] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:35.431944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.432308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.432491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.454698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:35.456505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:35.569229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 486/991] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:35.594067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c49b-ba66-46fb-b08d-681af4dc6e90 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.776977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085c49b-ba66-46fb-b08d-681af4dc6e90 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:35.781151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:35.845065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:35.846186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.846647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.847145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.848344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:35.850438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-506039b0-f38d-4a31-8703-252ce15aef59 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:35.869786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:35.871585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:35.872629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:35.874689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 506/992] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:35.880937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:35.886497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d23a-9fc2-4301-9ed8-b2e30fe72625 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.887406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d23a-9fc2-4301-9ed8-b2e30fe72625 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.887695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7d23a-9fc2-4301-9ed8-b2e30fe72625 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.889341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 507/993] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:35.895667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:35.896113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:35.896397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:35.916576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:35.918613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:36.031211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 508/994] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:36.032885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.053861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469e639-0713-4a74-a826-92b3c3a8ba25 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.055282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.096213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.097042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.097328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.097599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.098666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:36.098975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.100529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.107194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 487/995] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:36.114571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.187289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.193298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e98a22-b5cd-4525-993f-01e22241510a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.236964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.237627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.237907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.238180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.238817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.240210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.241949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789c84-ac6c-43cf-9dda-46a4001743a7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:36.249698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:36.251055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:36.251909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 509/996] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:36.257403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.287256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.288878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.289434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.289872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.291087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:36.291605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.294869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.304582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 488/997] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:36.312115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.338835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.408560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472ab3-e210-4a26-a3b4-b1a927b435a9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.442344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e1daf-363d-4746-bf58-e807220fa6b8 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.478131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.479084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.479548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.479954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.481294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:36.481842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.483813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.484457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.484568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.484740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.485063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.486040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] RBAC: Adding query filter params (interface=public, service_id=d33d9efaec5249159942ec4dc0d535fe, region_id=RegionOne) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:36.486356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.487953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.498734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 510/998] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:36.498950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 489/999] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/endpoints?service_id=d33d9efaec5249159942ec4dc0d535fe&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:36.499883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.500390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.546254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.617225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:36.647767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be667af-689a-4692-b217-e36915b5e748 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.678370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845a667-8510-457a-956d-c9cc43a69a47 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.688654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.689334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.689684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.689890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.690559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.693814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.710977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 490/1000] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/services => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:13:36.741630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.742805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.743372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.743866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.745283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:36.745838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.747963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2a014-27b1-4290-b19b-0e7355029ec6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:36.763025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 511/1001] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Jul 26 10:13:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:36.764008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:36.879029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b817b-5d9c-431d-9211-dde1ad19106c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.879381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b817b-5d9c-431d-9211-dde1ad19106c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.879589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b817b-5d9c-431d-9211-dde1ad19106c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.881250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 512/1002] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:36.886837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.887671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.887886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.911022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:36.912264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:36.926327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f373599-d309-4d27-9af7-525587aee649 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:36.975572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:36.976622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:36.977134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:36.977625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:36.978931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:36.982122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.000955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.010744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 491/1003] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:37.049967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 513/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:37.090597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.276224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17650db6-01bd-4164-a55b-fa519762ffcb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.315679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.316324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.316611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.316903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.317570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.318971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:37.329929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:37.331613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:37.333218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 492/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/services/image => generated 86 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:37.346023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.365920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.463205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99096641-50e9-43e3-9efe-4c3146b2df78 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.515156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.516638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.517146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.517620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.518489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:37.519161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.520937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28098c-e328-4a67-b80b-3ebd5cc647d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.528418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 514/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:37.534097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:37.606677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:37.652681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa559-f319-4056-baf6-497dbfe929d4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:37.691109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:37.691766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:37.692078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:37.692386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:37.693120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] RBAC: Adding query filter params (type=image) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:37.693462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:37.695045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0858a5-08a8-466f-9c2f-da9a80cedd91 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:37.701955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 493/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:38.839558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bcfb4-268e-4dd7-ad80-6da029c15252 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:38.840118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bcfb4-268e-4dd7-ad80-6da029c15252 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:38.840118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bcfb4-268e-4dd7-ad80-6da029c15252 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:38.841756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 515/1008] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:38.847190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:38.847871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:38.847871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:38.868753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:38.869991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:38.961425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 494/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:38 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:38.998832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bcfb4-268e-4dd7-ad80-6da029c15252 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:39.113246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:39.150736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bcfb4-268e-4dd7-ad80-6da029c15252 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:39.192230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:39.192921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.193276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.193450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.194131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:39.195592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-62f10044-f5f9-40ab-8071-f61e64a023f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:39.205877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:39.207358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 10:13:39.209054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:39.213236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:39.220882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 516/1010] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:39.238565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f8f9-f008-40e6-a717-8fd7257d58f7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.238895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f8f9-f008-40e6-a717-8fd7257d58f7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.239211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466f8f9-f008-40e6-a717-8fd7257d58f7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.241313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 517/1011] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:39.249163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.249534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.249864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.273643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:39.275151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:39.289803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:39.350547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e3a89-9c69-4ed9-b175-c2b3844ea47f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:39.357846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 518/1012] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:39.387226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:39.391789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:39.392432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.392715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.393023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.393708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:39.394012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:39.395399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:39.401001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 495/1013] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:39.409302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:39.495062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:39.530379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9ae95-4cb1-4fcd-9e41-43110e8be7fa None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:39.561718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f076-41cc-4d0f-b1b9-08d93b2c5b8f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:39.579900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:39.580605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.581075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.581489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.583081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:39.584812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:39.591519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 519/1014] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:39.593564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:39.598219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:39.614838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:39.615718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.616017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.616294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.617564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:39.617881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:39.619739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:39.631141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 496/1015] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Jul 26 10:13:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:39.632435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:39.723530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b39b4-1500-4811-8d81-58acf7236e24 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:39.752245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf6070-882a-4341-b7e0-753dfa4231ec None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:39.768908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b6b5f-0450-4c0a-81e5-f291bdeba631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:39.769539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6b5f-0450-4c0a-81e5-f291bdeba631 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.770095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6b5f-0450-4c0a-81e5-f291bdeba631 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.770095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b6b5f-0450-4c0a-81e5-f291bdeba631 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.770783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6b5f-0450-4c0a-81e5-f291bdeba631 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:39.772273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b6b5f-0450-4c0a-81e5-f291bdeba631 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:39.790513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:39.794750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:39.795471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.795675 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.795950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.796664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:39.798094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:39.807395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 520/1016] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:39 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:39.830508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e1f6-ef6d-4070-9dea-f606b6499ca2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.830829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e1f6-ef6d-4070-9dea-f606b6499ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.831041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e1f6-ef6d-4070-9dea-f606b6499ca2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.833109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 521/1017] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:39.836061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 497/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:39.842974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af282af-3609-4469-a3d1-aa67ca57af29 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:39.842974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af282af-3609-4469-a3d1-aa67ca57af29 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:39.843662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af282af-3609-4469-a3d1-aa67ca57af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:39.865707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3af282af-3609-4469-a3d1-aa67ca57af29 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:39.867154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3af282af-3609-4469-a3d1-aa67ca57af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:39.983255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 522/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:39 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:40.007976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:40.076327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:40.150002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e49a19-202e-4a0f-90ab-dacb8c8f9106 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:40.202697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d77b-6436-44bc-9e00-ac2c2156c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:40.204055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d77b-6436-44bc-9e00-ac2c2156c338 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:40.204566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d77b-6436-44bc-9e00-ac2c2156c338 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:40.205165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d77b-6436-44bc-9e00-ac2c2156c338 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:40.206577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d77b-6436-44bc-9e00-ac2c2156c338 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:40.209055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d77b-6436-44bc-9e00-ac2c2156c338 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:40.240960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 498/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:13:40 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:41.993842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70eef4-946c-4cbb-9bb3-48cf1db1775a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:41.994375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70eef4-946c-4cbb-9bb3-48cf1db1775a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:41.994375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70eef4-946c-4cbb-9bb3-48cf1db1775a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:41.995821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 523/1021] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:42.002117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.002641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.002828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.027770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:42.029449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:42.133189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc792-a34a-44f9-86dc-8bc9fd972e3e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.133890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc792-a34a-44f9-86dc-8bc9fd972e3e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.134439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cc792-a34a-44f9-86dc-8bc9fd972e3e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.136131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 524/1022] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:42.142563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.142842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.143308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.143474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 499/1023] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:42.163703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:42.164975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:42.169792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.215098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.254189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 525/1024] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:42.283827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.317630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278099af-2537-4c42-93e3-a89826e7f695 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.359110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.367166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.368171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.368728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.369344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.371881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.374621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.378183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 500/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:42.384306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.424722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b00fc-b5e7-4b46-93c8-a6c9b8b672de None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.469746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad1e2a-4c76-4585-9a50-466d2c08cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.470506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad1e2a-4c76-4585-9a50-466d2c08cfdb None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.470787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad1e2a-4c76-4585-9a50-466d2c08cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.471063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad1e2a-4c76-4585-9a50-466d2c08cfdb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.484489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad1e2a-4c76-4585-9a50-466d2c08cfdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-39ad1e2a-4c76-4585-9a50-466d2c08cfdb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:42.489648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:42.491353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:42.492700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 526/1026] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:42.496033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93336c-c173-44ca-8ee7-8f77d67e92da None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.496381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93336c-c173-44ca-8ee7-8f77d67e92da None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.496806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93336c-c173-44ca-8ee7-8f77d67e92da None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.498655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 527/1027] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:42.499469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93336c-c173-44ca-8ee7-8f77d67e92da None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.528904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.536082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98840d-1a5a-4d56-aa8f-625b7c33c473 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.575536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a63305-6905-476d-aa1b-86d4b064d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.577601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a63305-6905-476d-aa1b-86d4b064d19d None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.577879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a63305-6905-476d-aa1b-86d4b064d19d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.578197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a63305-6905-476d-aa1b-86d4b064d19d None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.578938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a63305-6905-476d-aa1b-86d4b064d19d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.580519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a63305-6905-476d-aa1b-86d4b064d19d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.603081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 501/1028] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:42.605043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.605393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.606026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.628086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:42.629503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:42.632141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93336c-c173-44ca-8ee7-8f77d67e92da None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.647979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.686791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.687548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.687889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.688172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.689073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:42.689384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.694287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.710262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 528/1029] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:42.716143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.737584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 502/1030] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:42.761528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.852598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c4f44-3a48-4248-842f-9c13cfb0770e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.860964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:42.887618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f396b-4c78-4d9c-921b-58e1bb530082 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:42.904076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.904731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.905123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.905538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.919842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.921381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.931090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:42.931755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:42.932073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:42.932312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] PATH_INFO: `/v3/services/image` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:42.933098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:42.934601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:42.941519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:42.942733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:42.943692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:42.943692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:42.943692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:42.943692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:42.945560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:42.946841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:42.947934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 503/1031] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:42.951409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 529/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:42.954046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.956481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:42.996961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.079187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061712bd-c7cf-4d92-85fa-3dd835dae8de None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.095299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dadfc-0593-4d9a-8869-043b266417bd None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.118345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.118969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.119265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.119520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.120262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.120606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.122121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.134141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.139773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 504/1033] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:43.139965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.139965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.139965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.139965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.139965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.139965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.140691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.146381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 530/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:43.152749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.153949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.277515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.290141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f36ef2-c980-407d-96a1-4cd1d07f0df3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.294696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12050b9-5237-4f70-ae2a-b66d0e8640a1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.336408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.337445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.337914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.338443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.339363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.339925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.341680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.346894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.347776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.348210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.348631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.358037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.359505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.360586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 531/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:43.369699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:43.379414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:43.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:43.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 505/1036] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:43.387930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.488712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.518405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd24d9-1cc1-4ce7-b659-b13a7aaaa1d6 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.533940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f5b837-cc48-4c53-8072-2fdaec3b730e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.556932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.557595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.557881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.558162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.558927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] RBAC: Adding query filter params (interface=public, service_id=e6cfea0a8c334b2eb3630ba4ca061037, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.559241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.560629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.566360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 532/1037] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/endpoints?service_id=e6cfea0a8c334b2eb3630ba4ca061037&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:43.571902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.584359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.585087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.585373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.585646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.586516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:43.586850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.588313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.594826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.616220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 506/1038] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:43.617623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:43.703325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7602bc-3eae-42a6-ad0a-0d6bdd728d99 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.741550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc43f53-4fd0-4ea1-94d3-00c50daa9424 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:43.747738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.748501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.748965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.749186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.749961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.751349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:43.767125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 533/1039] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:13:43.773263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:43.784321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:43.784865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:43.785160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:43.785423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:43.883971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:43.886888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.047383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 507/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:43 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:44.054192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.157722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.181339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d2074-cafb-4dba-b849-65f220227c88 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.226842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.227491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.227841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.228125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.240385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.241865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:44.257610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:44.258910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:44.260055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:44.260055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:44.260055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:44.260055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:44.261697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 534/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:44.265840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.298728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.382687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557b035-92f4-499f-ab67-90a535721388 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.420256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.420900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.421187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.421465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.422162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:44.422472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.423855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.443769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 508/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.445261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.576067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd06fe-059e-45cb-8136-14d275e4d06f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.608953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.617371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.618137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.618454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.618789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.626973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.628429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:44.641479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:44.649545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:44.651623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 535/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:44.656218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:44.804809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:44.833611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21ff2b-ca63-4f82-83c8-4aab23f65eea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:44.895601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:44.896581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:44.897125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:44.897627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:44.899068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:44.899639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:44.901906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af101d1-4ba2-46ac-93ec-5f31196e3885 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:44.924888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 509/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:44.928898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.004125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f417-7780-44c3-b652-7ceb0c4e2752 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.004416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f417-7780-44c3-b652-7ceb0c4e2752 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.004691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f417-7780-44c3-b652-7ceb0c4e2752 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.007433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 510/1045] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:45.012223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.012546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.012689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.042934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:45.045437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:45.104945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e35518-7e63-4c7e-b59a-9f8a090520c0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.149324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 511/1046] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:45.165424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.166507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.167014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.167511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.169243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] RBAC: Adding query filter params (role.id=53ae1c37fc3948a89edface7ba76277c, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=038cbaf398214c2cbca2383eb8fa7fa5) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:45.170004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.172857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.178321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.181686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 536/1047] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:44 2022] GET /identity/v3/role_assignments?user.id=038cbaf398214c2cbca2383eb8fa7fa5&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=53ae1c37fc3948a89edface7ba76277c => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:45.314969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.361320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3807b-d5dd-41e9-80f8-886db1394dde None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.406126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.406992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.407449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.407787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.421299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:45.426302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:45.428064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:45.430061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 512/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:45.444516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.518371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.597578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac758d1-2db5-42f8-a61d-d7916f55bee7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.639707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.640351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.640671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.641238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.641801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:45.642112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.643590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.660984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 537/1049] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:45.662841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.791635 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50746-f1b1-4c18-8370-f88e39f2b64e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:45.831362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cf06e-7c2f-4ea5-91d1-4e800ea5e5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:45.832004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cf06e-7c2f-4ea5-91d1-4e800ea5e5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.832275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cf06e-7c2f-4ea5-91d1-4e800ea5e5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.832556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cf06e-7c2f-4ea5-91d1-4e800ea5e5f9 None admin] PATH_INFO: `/v3/users/7814a3a7065543879d2fa7a21aef1912` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.835127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:45.860096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cf06e-7c2f-4ea5-91d1-4e800ea5e5f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7814a3a7065543879d2fa7a21aef1912)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:45.862860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60cf06e-7c2f-4ea5-91d1-4e800ea5e5f9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:45.865123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 513/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/users/7814a3a7065543879d2fa7a21aef1912 => generated 285 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:45.871761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:45.913241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bab8fb-f8e4-4261-934a-b6fb4d97f202 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.913663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bab8fb-f8e4-4261-934a-b6fb4d97f202 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.914296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bab8fb-f8e4-4261-934a-b6fb4d97f202 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.916183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 514/1051] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:45.922337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:45.922620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:45.922892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:45.943273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:45.944575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:46.018695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cca94-c11f-4eae-a892-20d3919b5f38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.040891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 515/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:46.049286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.065923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.071154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.071880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.072172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.072449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.157916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.161688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.224087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3d353-91be-45da-a5f5-a9f9e06bbc49 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.270317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.285236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.285998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.286279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.286557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] PATH_INFO: `/v3/services/image` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.287193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.288588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.300115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 538/1053] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:46.300378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:46.302109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 10:13:46.303193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:46.305191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 516/1054] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/services/image => generated 86 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:46.308569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.308756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.337319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.454061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184565ce-846d-4359-b7ce-98598e9bb902 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.454668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae35ff-f21c-4fc9-b3ce-d8ffe1a5c3cf None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.494550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.495173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.495452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.495645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.495763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.496275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.496550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.496896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.497262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1e2a75d83a23476a953f95d94b7b68cf)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.497979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:46.498412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.498887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.500126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.507104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 517/1055] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf => generated 311 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:46.509354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.516895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 539/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:46.519127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.596639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.627032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:46.658334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96149d5-b39c-49fc-96a9-3546b07091d2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.658783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8b8ec-c99b-4b9e-9255-8d9629ed5db2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.702079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.702711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.702993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.703273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.703960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] RBAC: Adding query filter params (type=image) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:46.704261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.705727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.717281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 540/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:46.719091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:46.721108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.721741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.722139 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.722315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.724072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=1e2a75d83a23476a953f95d94b7b68cf, user.id=7814a3a7065543879d2fa7a21aef1912) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:46.724072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.724881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5caa4d-20d9-4af9-b7d5-d5fbff2e9334 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.731799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 518/1058] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:46 2022] GET /identity/v3/role_assignments?user.id=7814a3a7065543879d2fa7a21aef1912&scope.project.id=1e2a75d83a23476a953f95d94b7b68cf&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:46.873243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a35680-862f-4984-8066-d8809bc37904 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:46.925943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e5bcf-d4fc-4971-8717-f5f991ea7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:46.927112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e5bcf-d4fc-4971-8717-f5f991ea7e6c None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:46.927393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e5bcf-d4fc-4971-8717-f5f991ea7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:46.927664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e5bcf-d4fc-4971-8717-f5f991ea7e6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:46.928389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e5bcf-d4fc-4971-8717-f5f991ea7e6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:46.929862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e5bcf-d4fc-4971-8717-f5f991ea7e6c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:46.955065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 541/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:13:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:13:47.301755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa720ee-2ba4-42a0-b0cb-47dfe12ffdae None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.301951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa720ee-2ba4-42a0-b0cb-47dfe12ffdae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.302246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa720ee-2ba4-42a0-b0cb-47dfe12ffdae None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.303900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 519/1060] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:47.309404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.309928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.309928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.317143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:47.332033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:47.333324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:47.431701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 542/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:47.458354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa720ee-2ba4-42a0-b0cb-47dfe12ffdae None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:47.629046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa720ee-2ba4-42a0-b0cb-47dfe12ffdae None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:47.661347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:47.690858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:47.692014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.692557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.693292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.711196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:47.717094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:47.718433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:47.719571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:47.726535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 520/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 26 10:13:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:47.726840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:47.854364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae4e8d-a7a6-40a7-a6d8-9dc8295d714c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:47.888483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:47.897828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:47.898464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:47.898737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:47.899004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:47.899723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:47.900012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:47.901966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:47.911298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 543/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:13:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:47.919172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.072649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c576b-74fc-4650-afd9-0ce592c78d01 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.117004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.117671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.117943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.118214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.132967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.134639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:48.153426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:48.154947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:48.156229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:48.156229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:48.156229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:48.156229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:48.156229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 521/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:48.161143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.273088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631d95d-b49d-430b-b586-5c85de56b23c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.312293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.313215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.313215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.313578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.314209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:48.314517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.315866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.335085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 544/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:48.336547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.382958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.495987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c1cd6-917b-4142-929d-e940413e42fa None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.539410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.540282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.540561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.541004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.555639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.557447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:48.570327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:48.571551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:48.572672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 522/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:48.577400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.634683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.690166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8572-670d-471f-b4c3-dd414b55cc06 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.730908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.731541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.731812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.732105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.732935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:48.733319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.734785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a09d6-6545-4d30-937f-adc748152209 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.755664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 545/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:48.761407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.863018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:48.875033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2986ece-5020-45ad-b6ec-5644dc69797b None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:48.913201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:48.914107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.914593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.914986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.931210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:48.933397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b64a-5dd5-416f-9aee-c3ff3a08ef17 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.933729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b64a-5dd5-416f-9aee-c3ff3a08ef17 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.933951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b64a-5dd5-416f-9aee-c3ff3a08ef17 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.935222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:48.935935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 546/1068] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:48.951043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:48.951043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:48.951043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:48.963323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:48.965091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:48.966535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:48.966535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:48.966535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:48.966535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:48.966535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 523/1069] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:48.973574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:48.986535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:48.987890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:49.082883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 547/1070] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:49.108602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.125877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e1a71-42b4-42a0-a6c4-501c6fd38128 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.157022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.175717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.176763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.177256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.177660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.178866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:49.179395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.181938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e38f0-00fb-42fe-9569-37f55a85cf5c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.203881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 524/1071] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:49.206428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce814-77c8-497b-995a-ef7959c3bc83 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.206726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce814-77c8-497b-995a-ef7959c3bc83 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.207004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbce814-77c8-497b-995a-ef7959c3bc83 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.208443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 525/1072] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:49.214987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce814-77c8-497b-995a-ef7959c3bc83 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.219495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.235826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d953444-dc40-4af2-a3e6-df1683a84e79 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.286936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7acaeb-bf84-4d1f-85db-24f2fdac362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.287678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7acaeb-bf84-4d1f-85db-24f2fdac362a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.287971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7acaeb-bf84-4d1f-85db-24f2fdac362a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.288239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7acaeb-bf84-4d1f-85db-24f2fdac362a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.300365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7acaeb-bf84-4d1f-85db-24f2fdac362a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-dc7acaeb-bf84-4d1f-85db-24f2fdac362a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:49.305329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:49.306594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:49.307912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 548/1073] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:49.309616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.309616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.309616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.328565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:49.329943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:49.359142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbce814-77c8-497b-995a-ef7959c3bc83 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.396386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.397065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.397346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.397657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.408164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.413904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.420242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 549/1074] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:49.421288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:49.423676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:49.424802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:49.425893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 526/1075] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:49.431350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.455882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.511241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.553684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae825032-34b7-4e93-aed0-145d59d2eade None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.555519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621618b0-dc47-4f7f-9178-5540fb3fe052 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.593851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.594476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.594751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.595020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.595767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:49.596069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.597532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.597765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.598571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.598896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.599284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.599915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:49.600533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.601724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.611705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 550/1076] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:49.612463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.613164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 527/1077] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:49.619253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.725787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.741480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ead68-0180-4fa5-9acb-6403bc30fc48 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.745849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a980903-e4cf-4684-a562-1b20d13041b2 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.781985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:49.790516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.791454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.791710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.792654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.797461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.798309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.798590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.798916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] PATH_INFO: `/v3/users/7814a3a7065543879d2fa7a21aef1912` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.800494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] RBAC: Authorizing `identity:get_user(user_id=7814a3a7065543879d2fa7a21aef1912)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.802135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.803950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 528/1078] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/users/7814a3a7065543879d2fa7a21aef1912 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:49.805716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:49.891054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.893077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.929826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b0139-8ab0-4aa8-a0ed-3aac068f34e0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:49.972136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:49.972829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:49.973145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:49.973421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/038cbaf398214c2cbca2383eb8fa7fa5/roles/53ae1c37fc3948a89edface7ba76277c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:49.975896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=038cbaf398214c2cbca2383eb8fa7fa5, role_id=53ae1c37fc3948a89edface7ba76277c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:49.977441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:49.994148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 529/1079] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:49 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/038cbaf398214c2cbca2383eb8fa7fa5/roles/53ae1c37fc3948a89edface7ba76277c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:13:49.996227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.000576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.022647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 551/1080] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:50.038751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.058607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.145728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd7e6cc-753c-4779-bd86-f374844088da None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.199344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b692a5-3c6f-4ef3-8ffe-e156f13a932c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.203849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.205008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.205495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.205984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.208138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] RBAC: Authorizing `identity:get_project(project_id=1e2a75d83a23476a953f95d94b7b68cf)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.210052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.213222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 530/1081] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:49 2022] GET /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf => generated 311 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:50.223173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.239630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.240513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.240647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.240826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.252374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.253875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:50.272036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:50.273306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:50.274274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:50.274274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:50.274274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:50.274274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:50.274274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 552/1082] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:50.281961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:50.353085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.364465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82725ed3-8bba-4967-9950-a301037f1a87 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.389177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:50.414496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2cf98-16c5-49ff-8fec-9bd1e2d6c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.415124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2cf98-16c5-49ff-8fec-9bd1e2d6c524 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.415400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2cf98-16c5-49ff-8fec-9bd1e2d6c524 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.415664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2cf98-16c5-49ff-8fec-9bd1e2d6c524 None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf/users/7814a3a7065543879d2fa7a21aef1912/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.418584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2cf98-16c5-49ff-8fec-9bd1e2d6c524 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e2a75d83a23476a953f95d94b7b68cf, user_id=7814a3a7065543879d2fa7a21aef1912, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.420376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2cf98-16c5-49ff-8fec-9bd1e2d6c524 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.443134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 531/1083] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:13:50 2022] PUT /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf/users/7814a3a7065543879d2fa7a21aef1912/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:13:50.447470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee74485-f795-4bf6-b9f0-cf9d1f9d910c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:50.490835 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:50.491482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:50.491765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:50.492032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:50.492767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:50.493111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:50.494551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c011047-5274-4bb3-8ad0-2ffc0e6c3a1d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:50.516887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 553/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:52.299204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aba08-3d0d-45ae-995f-1d991a7be6ac None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.299747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aba08-3d0d-45ae-995f-1d991a7be6ac None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.299747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aba08-3d0d-45ae-995f-1d991a7be6ac None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.301198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 532/1085] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:52.306373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddbf3-a52a-40aa-b359-f56414325717 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.306829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddbf3-a52a-40aa-b359-f56414325717 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.307062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddbf3-a52a-40aa-b359-f56414325717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.326607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-c3fddbf3-a52a-40aa-b359-f56414325717 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:52.327824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c3fddbf3-a52a-40aa-b359-f56414325717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:52.398184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 554/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:52.422605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aba08-3d0d-45ae-995f-1d991a7be6ac None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.543254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aba08-3d0d-45ae-995f-1d991a7be6ac None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.571034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b535b-52f8-4601-85be-8f10e650ce88 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.571244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b535b-52f8-4601-85be-8f10e650ce88 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.571497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b535b-52f8-4601-85be-8f10e650ce88 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.572861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 555/1087] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:13:52.579467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41752e5-f050-4510-8862-e86162457930 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.579467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41752e5-f050-4510-8862-e86162457930 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.579467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41752e5-f050-4510-8862-e86162457930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.591987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.592645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.592958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.593230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.598364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b41752e5-f050-4510-8862-e86162457930 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:52.599771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b41752e5-f050-4510-8862-e86162457930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:52.609177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:52.616387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:52.617828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:52.619259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 533/1088] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:52.626716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.629475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.674252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.676502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 556/1089] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:13:52.701572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41752e5-f050-4510-8862-e86162457930 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.749861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a3c11-d842-4fe2-974d-c2c63f789b98 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.791638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.792639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.793098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.793647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.794814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:52.795317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:52.797729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:52.811872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 534/1090] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:52.820288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.825134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41752e5-f050-4510-8862-e86162457930 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.863714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.864377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.864657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.864965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.877302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:13:52.882804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:52.883822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:52.884809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 557/1091] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:52.891465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:52.919854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.939588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:52.943123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a796e-d3cd-4da8-80bc-2c092486c713 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:52.983791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:52.984401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:52.984728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:52.985046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:52.997460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:52.999929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:53.014670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:53.016134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:53.017449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:53.017449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:53.017449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:53.017449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:53.017449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 535/1092] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:13:53.021604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.023076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233bf94e-7691-4bca-a020-ff1c3e766b36 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.065886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00239765-a318-45db-91c9-74bd76952636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.066510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00239765-a318-45db-91c9-74bd76952636 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.066790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00239765-a318-45db-91c9-74bd76952636 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.067054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00239765-a318-45db-91c9-74bd76952636 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.067774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00239765-a318-45db-91c9-74bd76952636 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.068070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00239765-a318-45db-91c9-74bd76952636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.069491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00239765-a318-45db-91c9-74bd76952636 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.078674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 558/1093] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:53.084388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00239765-a318-45db-91c9-74bd76952636 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.144853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acd4e7-d13b-4479-ac6b-5fa7232ee4b0 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.184152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.192068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.193131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.193627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.194096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.195437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.195965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.199315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.200762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00239765-a318-45db-91c9-74bd76952636 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.222062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 536/1094] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:53.228015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.239018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.239667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.239954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.240227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] PATH_INFO: `/v3/users/7814a3a7065543879d2fa7a21aef1912` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.241449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] RBAC: Authorizing `identity:get_user(user_id=7814a3a7065543879d2fa7a21aef1912)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.242883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.244623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 559/1095] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/users/7814a3a7065543879d2fa7a21aef1912 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:53.248145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.251928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.370109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce3686-707a-4a33-ba37-5415d4a87757 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.376915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a961c-a256-4531-b3ce-4d5aed5b0198 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.408402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.409229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.409517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.409794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.414289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.414921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.415199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.415471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.418693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.420184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:13:53.433209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:53.434473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:13:53.435692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 537/1096] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:53.440968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.445659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.508174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.509725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.536529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.569379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b8d87-8b20-40cd-86a7-a29502a94b13 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.608155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.608786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.609088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.609365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.610172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.610485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.611985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.619954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 560/1097] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 10:13:53.626200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.633258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 538/1098] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:53.639561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.683912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.737109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5eada-5383-4de8-9d36-abbb92b62e92 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.749640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af429245-304c-4a56-a216-f94dec5a4e8a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.773318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.773973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.774252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.774525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.775729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] RBAC: Authorizing `identity:get_project(project_id=1e2a75d83a23476a953f95d94b7b68cf)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.777803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.779525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 561/1099] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:53.782812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.785927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:53.789756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.790464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.790750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.791021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.875370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.876917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.901682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2851d-dcce-495c-86e4-e3092111ba1e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:53.928100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:53.949017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:53.950339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:53.950339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:53.950339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:53.950995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=1e2a75d83a23476a953f95d94b7b68cf, user.id=7814a3a7065543879d2fa7a21aef1912) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:53.951307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:53.952766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:53.959452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 562/1100] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/role_assignments?user.id=7814a3a7065543879d2fa7a21aef1912&scope.project.id=1e2a75d83a23476a953f95d94b7b68cf&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:13:53.989434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 539/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 10:13:53.995960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.106794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaee052-91b8-4ecd-9168-3819d7837f79 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.141808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.142374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.142662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.142925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.153539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.154982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:13:54.169225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:54.170265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:54.171162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:13:54.171162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:13:54.171162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:13:54.171162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:54.171162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 563/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:54.176364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.206884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.277738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec735a8-cfba-4e64-8652-08d17bab4f6d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.311749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.312374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.312744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.313053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.313752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:54.314049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.315422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.328922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 540/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:54.336458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.371144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.437307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3116d-2de2-4c63-85de-e6e90c2fbb64 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.472660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.473341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.473617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.473899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.481764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.483251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:13:54.494888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:13:54.496352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:13:54.497649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 564/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:13:54.502557 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.596479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.607011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1055148-dfdd-48d3-bb17-768b97eba56d None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.646903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.647529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.647807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.648081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.648859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:54.649170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.650612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6c4de-2e17-4b01-b400-7c2ca05efd61 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.664036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 541/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:54.670656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:54.767347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:54.773415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cbccb-54f7-4dc6-ba6d-83c8ca75d5d3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:54.807020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:54.807836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:54.808109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:54.808378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:54.809200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] RBAC: Adding query filter params (role.id=53ae1c37fc3948a89edface7ba76277c, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=038cbaf398214c2cbca2383eb8fa7fa5) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:54.809508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:54.810936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef63a1a-1e81-44dd-beb6-4a89cd2bfe05 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:54.817115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 565/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:54 2022] GET /identity/v3/role_assignments?user.id=038cbaf398214c2cbca2383eb8fa7fa5&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=53ae1c37fc3948a89edface7ba76277c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:56.043886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ea8c8-8664-4b0c-b1dd-9c97ca52a286 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:56.044412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ea8c8-8664-4b0c-b1dd-9c97ca52a286 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:56.044412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ea8c8-8664-4b0c-b1dd-9c97ca52a286 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:56.045805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 542/1107] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:56.051044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:56.051461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:56.051575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:56.070113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:56.071312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:56.136815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 566/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:56.160631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ea8c8-8664-4b0c-b1dd-9c97ca52a286 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:56.261913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ea8c8-8664-4b0c-b1dd-9c97ca52a286 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:56.295829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b67d1-8a83-436a-bb0a-dbea772dc866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:56.296471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b67d1-8a83-436a-bb0a-dbea772dc866 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:56.296751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b67d1-8a83-436a-bb0a-dbea772dc866 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:56.297055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b67d1-8a83-436a-bb0a-dbea772dc866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:56.298194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b67d1-8a83-436a-bb0a-dbea772dc866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:56.299626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b67d1-8a83-436a-bb0a-dbea772dc866 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:56.301276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 543/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:13:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:56.307097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:56.394408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:56.404664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0a322-78b4-42d4-b8cb-c2e038e5f4d7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:56.439795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb48595-0583-4169-8cb1-1a53439b198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:56.440424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48595-0583-4169-8cb1-1a53439b198f None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:56.440736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48595-0583-4169-8cb1-1a53439b198f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:56.441039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb48595-0583-4169-8cb1-1a53439b198f None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:56.441766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb48595-0583-4169-8cb1-1a53439b198f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:56.443264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb48595-0583-4169-8cb1-1a53439b198f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:56.466528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 567/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:13:56 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:13:58.524038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0dd87-c196-4315-8950-2fe415102530 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.524577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0dd87-c196-4315-8950-2fe415102530 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.524577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0dd87-c196-4315-8950-2fe415102530 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.526486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 544/1111] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:13:58.531643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.532054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.532167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.551789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:13:58.553005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:13:58.617776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 568/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:13:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:13:58.640407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0dd87-c196-4315-8950-2fe415102530 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.659789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.744294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0dd87-c196-4315-8950-2fe415102530 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.779802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.780350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.780628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.780927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] PATH_INFO: `/v3/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.782391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] RBAC: Authorizing `identity:get_role(role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.783764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.785170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 545/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:58 2022] GET /identity/v3/roles/73a9432602da4fa9aed56acc5eae9592 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:58.791106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:58.866470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:58.889597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428767-8a5c-48e5-82f5-e484221efc5c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:58.922959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:58.923597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:58.923871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:58.924141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] PATH_INFO: `/v3/users/8317128172554c07a4f6a4af4a4dbb59` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:58.938691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] RBAC: Authorizing `identity:get_user(user_id=8317128172554c07a4f6a4af4a4dbb59)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:58.940150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:58.942625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 569/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:13:58 2022] GET /identity/v3/users/8317128172554c07a4f6a4af4a4dbb59 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:58.949705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:59.035432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:59.050496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77634763-2d5d-468d-9267-5003a6f630a7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:59.083525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:59.084138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:59.084414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:59.084683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:59.149809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:59.151824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:59.236464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:13:59.251886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 546/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:13:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:13:59.257940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:59.374126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b6c8d-e3d4-4242-8fc5-fb5efce6012f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:59.408126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749615c-78c3-4649-a166-b66356c2b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:59.408765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749615c-78c3-4649-a166-b66356c2b8ec None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:59.409076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749615c-78c3-4649-a166-b66356c2b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:59.409351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749615c-78c3-4649-a166-b66356c2b8ec None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:59.410512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749615c-78c3-4649-a166-b66356c2b8ec None admin] RBAC: Authorizing `identity:get_project(project_id=1e2a75d83a23476a953f95d94b7b68cf)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:59.411939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749615c-78c3-4649-a166-b66356c2b8ec None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:59.413655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 570/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:13:59 2022] GET /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:13:59.420426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:13:59.536016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb23c8a-f87e-44ac-8b02-0bab73aeea08 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:13:59.569440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:13:59.570052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:13:59.570332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:13:59.570606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:13:59.571387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] RBAC: Adding query filter params (role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=1e2a75d83a23476a953f95d94b7b68cf, user.id=8317128172554c07a4f6a4af4a4dbb59) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:13:59.571696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:13:59.573202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55747f-1caa-4dd0-aac2-210ea83caf81 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:13:59.578542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 547/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:13:59 2022] GET /identity/v3/role_assignments?user.id=8317128172554c07a4f6a4af4a4dbb59&scope.project.id=1e2a75d83a23476a953f95d94b7b68cf&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.547922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6638e4-3689-4a40-8fc2-bd89f6e21759 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.548454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6638e4-3689-4a40-8fc2-bd89f6e21759 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.548454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6638e4-3689-4a40-8fc2-bd89f6e21759 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.549857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 571/1118] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:01.554845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.555274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.555393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.574167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:01.575350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:01.620905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.642226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 548/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:01.664299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6638e4-3689-4a40-8fc2-bd89f6e21759 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.667215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:01.763600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6638e4-3689-4a40-8fc2-bd89f6e21759 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.795211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.795838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.796114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.796383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] PATH_INFO: `/v3/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.797802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] RBAC: Authorizing `identity:get_role(role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.799203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.800485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 572/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/roles/73a9432602da4fa9aed56acc5eae9592 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.806425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:01.904257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07bc9f-989a-410d-8229-1cb0aeb7a18e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:01.937748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:01.938376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:01.938651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:01.938919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] PATH_INFO: `/v3/users/8317128172554c07a4f6a4af4a4dbb59` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:01.940046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] RBAC: Authorizing `identity:get_user(user_id=8317128172554c07a4f6a4af4a4dbb59)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:01.941502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:01.943105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 549/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/users/8317128172554c07a4f6a4af4a4dbb59 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:01.949205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.015503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.045710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdaf39a-1446-45a4-bee0-1d73e8f98fc7 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.078006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c1352-c371-4ada-8faa-a603151e5a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.078574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c1352-c371-4ada-8faa-a603151e5a7a None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.078849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c1352-c371-4ada-8faa-a603151e5a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.079121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c1352-c371-4ada-8faa-a603151e5a7a None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.080244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c1352-c371-4ada-8faa-a603151e5a7a None admin] RBAC: Authorizing `identity:get_project(project_id=1e2a75d83a23476a953f95d94b7b68cf)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.081687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c1352-c371-4ada-8faa-a603151e5a7a None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.083332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 573/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:01 2022] GET /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:02.089477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:02.138170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:02.187946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a763dd-7d77-49fd-8ad8-3ecc127eaf3f None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:02.220813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd069-3304-4566-ab8b-35a575e6e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:02.221503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd069-3304-4566-ab8b-35a575e6e3b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:02.221784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd069-3304-4566-ab8b-35a575e6e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:02.222057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd069-3304-4566-ab8b-35a575e6e3b7 None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf/users/8317128172554c07a4f6a4af4a4dbb59/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:02.224213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd069-3304-4566-ab8b-35a575e6e3b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e2a75d83a23476a953f95d94b7b68cf, user_id=8317128172554c07a4f6a4af4a4dbb59, role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:02.225674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd069-3304-4566-ab8b-35a575e6e3b7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:02.239075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 550/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:02 2022] PUT /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf/users/8317128172554c07a4f6a4af4a4dbb59/roles/73a9432602da4fa9aed56acc5eae9592 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:14:04.254971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91577-1a41-46fc-b5d5-e5e130e01e90 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.255480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91577-1a41-46fc-b5d5-e5e130e01e90 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.255480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a91577-1a41-46fc-b5d5-e5e130e01e90 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.256762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 574/1124] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:04.262409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.262800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.262961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.280971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:04.282142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:04.347589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 551/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:04.370528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a91577-1a41-46fc-b5d5-e5e130e01e90 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.473098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a91577-1a41-46fc-b5d5-e5e130e01e90 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.507293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.507853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.508132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.508403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] PATH_INFO: `/v3/roles/73a9432602da4fa9aed56acc5eae9592` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.509854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] RBAC: Authorizing `identity:get_role(role_id=73a9432602da4fa9aed56acc5eae9592)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.511750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.513128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 575/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/roles/73a9432602da4fa9aed56acc5eae9592 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.519003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.560343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.619071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6dd2a-3067-443c-a375-f88495cf4f96 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.652090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.652716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.653021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.653294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] PATH_INFO: `/v3/users/8317128172554c07a4f6a4af4a4dbb59` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.654434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] RBAC: Authorizing `identity:get_user(user_id=8317128172554c07a4f6a4af4a4dbb59)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.655852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.657466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 552/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/users/8317128172554c07a4f6a4af4a4dbb59 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:04.663291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:04.671954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.760149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735f0b-b523-405f-a109-6ee71bc6bc03 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:04.792493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:04.793125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:04.793404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:04.793678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:04.857425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:04.858871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:04.866363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:04.954159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 576/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 10:14:04.960031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.056770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b6b69-e629-4455-9276-0ac6e6ac77fd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.064568 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:05.090903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2084a30-bba5-4e25-8882-f4f3238bf082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.091542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2084a30-bba5-4e25-8882-f4f3238bf082 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.091821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2084a30-bba5-4e25-8882-f4f3238bf082 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.092095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2084a30-bba5-4e25-8882-f4f3238bf082 None admin] PATH_INFO: `/v3/projects/1e2a75d83a23476a953f95d94b7b68cf` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.093275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2084a30-bba5-4e25-8882-f4f3238bf082 None admin] RBAC: Authorizing `identity:get_project(project_id=1e2a75d83a23476a953f95d94b7b68cf)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.094714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2084a30-bba5-4e25-8882-f4f3238bf082 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.096371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 553/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:04 2022] GET /identity/v3/projects/1e2a75d83a23476a953f95d94b7b68cf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:05.102541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:05.198076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9dd09-31bf-49ac-b2af-016a776dc48b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:05.206223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:05.232758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:05.233393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:05.233671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:05.233941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:05.234714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] RBAC: Adding query filter params (role.id=73a9432602da4fa9aed56acc5eae9592, scope.project.id=1e2a75d83a23476a953f95d94b7b68cf, user.id=8317128172554c07a4f6a4af4a4dbb59) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:05.235019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:05.236433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21ab88-cdfb-41bc-b479-a75b28b1cb96 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:05.242077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 577/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:05 2022] GET /identity/v3/role_assignments?user.id=8317128172554c07a4f6a4af4a4dbb59&scope.project.id=1e2a75d83a23476a953f95d94b7b68cf&role.id=73a9432602da4fa9aed56acc5eae9592 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:07.263645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397505-4c2e-4a6e-bfb5-322d8fa000f8 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.264141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397505-4c2e-4a6e-bfb5-322d8fa000f8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.264141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397505-4c2e-4a6e-bfb5-322d8fa000f8 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.265524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 554/1131] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:07.270918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.271339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.271468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.289032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:07.290211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:07.355264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 578/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:07.379298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f397505-4c2e-4a6e-bfb5-322d8fa000f8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.485735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f397505-4c2e-4a6e-bfb5-322d8fa000f8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.519534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45662fe-8dc3-43d2-9ea9-2e7d3f873942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.520096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45662fe-8dc3-43d2-9ea9-2e7d3f873942 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.520374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45662fe-8dc3-43d2-9ea9-2e7d3f873942 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.520646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45662fe-8dc3-43d2-9ea9-2e7d3f873942 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.521808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45662fe-8dc3-43d2-9ea9-2e7d3f873942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.523237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45662fe-8dc3-43d2-9ea9-2e7d3f873942 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:07.524821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 555/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:07.531535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:07.625057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:07.627895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe45ec-e2d8-4130-a27c-830875c53f7b None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:07.661414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab9f1c-92b8-442f-89cf-77cbae6e0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:07.662037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab9f1c-92b8-442f-89cf-77cbae6e0b07 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:07.662320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab9f1c-92b8-442f-89cf-77cbae6e0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:07.662596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab9f1c-92b8-442f-89cf-77cbae6e0b07 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:07.663278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab9f1c-92b8-442f-89cf-77cbae6e0b07 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:07.664704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab9f1c-92b8-442f-89cf-77cbae6e0b07 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:07.691338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 579/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:07 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:09.713415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c99cc-b055-4961-9ed4-444ad46c4a5a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.713955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c99cc-b055-4961-9ed4-444ad46c4a5a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.713955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c99cc-b055-4961-9ed4-444ad46c4a5a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.715286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 556/1135] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:09.720333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.720706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.720929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.740264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:09.741514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:09.806723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 580/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:09.831038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c99cc-b055-4961-9ed4-444ad46c4a5a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:09.875573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:09.930694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c99cc-b055-4961-9ed4-444ad46c4a5a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:09.964579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db258fc8-0ded-4158-85f9-7ac49b80a9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:09.965185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258fc8-0ded-4158-85f9-7ac49b80a9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:09.965460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258fc8-0ded-4158-85f9-7ac49b80a9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:09.965729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db258fc8-0ded-4158-85f9-7ac49b80a9d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:09.966865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db258fc8-0ded-4158-85f9-7ac49b80a9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:09.968293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db258fc8-0ded-4158-85f9-7ac49b80a9d1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:09.969909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 557/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:14:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:09.975636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:10.063239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:10.082043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e9db2-3c26-4e3d-8876-bf4af656209c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:10.114440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db067770-ef7b-45b8-94ab-10fe262e5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:10.115144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db067770-ef7b-45b8-94ab-10fe262e5098 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:10.115424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db067770-ef7b-45b8-94ab-10fe262e5098 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:10.115695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db067770-ef7b-45b8-94ab-10fe262e5098 None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:10.116376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db067770-ef7b-45b8-94ab-10fe262e5098 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:10.117813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db067770-ef7b-45b8-94ab-10fe262e5098 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:10.139275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 581/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:14:09 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:14:12.195944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91fa34-6055-45fc-b126-1036489ec59c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.196513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91fa34-6055-45fc-b126-1036489ec59c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.196513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91fa34-6055-45fc-b126-1036489ec59c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.197917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 558/1139] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:12.203388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.203847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.203942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.222851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:12.224054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:12.291094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 582/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:12.314980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91fa34-6055-45fc-b126-1036489ec59c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.418438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91fa34-6055-45fc-b126-1036489ec59c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.429457 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:12.455379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.455935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.456215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.456487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.467907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:12.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:12.473965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:14:12.475025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 559/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:12.482320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.547896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:12.582012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ea8a-0a6c-4fc2-82d0-e91991fc0546 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.617188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.617820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.618100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.618372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.619111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:12.619487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:12.620880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:12.629698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 583/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:12.636151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.736179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39952b76-3926-47ea-9b32-4706f59b3c5a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.771293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.771933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.772210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.772479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] PATH_INFO: `/v3/users/4faf793d114b4e3ba30256d21cedf6a3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:12.786218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=4faf793d114b4e3ba30256d21cedf6a3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:12.787656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:12.789343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 560/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/users/4faf793d114b4e3ba30256d21cedf6a3 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:12.795343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:12.898301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ab98e-1b8b-408c-bf16-f4493b3a62b1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:12.925850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:12.932856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:12.933497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:12.933780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:12.934057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.004210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.005608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.108266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 584/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:13.115165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.143386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.216247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02381370-4b76-4708-941d-fea4a99ae0c1 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.251249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730d9c-8f6b-4893-8082-ab783ed511f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.251890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730d9c-8f6b-4893-8082-ab783ed511f9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.252168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730d9c-8f6b-4893-8082-ab783ed511f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.252437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730d9c-8f6b-4893-8082-ab783ed511f9 None admin] PATH_INFO: `/v3/projects/d6f94831005849cfa4b2dfda4e6d085c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.253628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51730d9c-8f6b-4893-8082-ab783ed511f9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6f94831005849cfa4b2dfda4e6d085c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.255115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51730d9c-8f6b-4893-8082-ab783ed511f9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.256747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 561/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/projects/d6f94831005849cfa4b2dfda4e6d085c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:13.263235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:13.293494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:13.364266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ed62-1a9c-4d0d-9374-de151d66fdf9 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:13.398138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:13.398760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:13.399040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:13.399313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:13.400103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=d6f94831005849cfa4b2dfda4e6d085c, user.id=4faf793d114b4e3ba30256d21cedf6a3) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:13.400410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:13.401903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a6381-0757-4539-9e47-d8452d2fff1e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:13.407489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 585/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:13 2022] GET /identity/v3/role_assignments?user.id=4faf793d114b4e3ba30256d21cedf6a3&scope.project.id=d6f94831005849cfa4b2dfda4e6d085c&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.431065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6481a-d2c5-4558-8d03-474f8b005869 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.431614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6481a-d2c5-4558-8d03-474f8b005869 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.431614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6481a-d2c5-4558-8d03-474f8b005869 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.433122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 562/1147] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:15.438615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.439057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.439174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.458269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:15.459483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:15.529088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 586/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:15.552195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6481a-d2c5-4558-8d03-474f8b005869 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.656489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.664140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6481a-d2c5-4558-8d03-474f8b005869 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.699348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.699993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.700274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.700542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.711735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:15.716784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:15.717913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:14:15.719122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 563/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:15.724263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:15.753963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:15.848832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a577-35ac-4976-9d12-5856030e1603 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:15.886792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:15.887417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:15.887695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:15.887969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:15.888700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:15.889030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:15.890413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:15.899419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 587/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:15.906085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.013174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413189e-2dee-423b-904a-0e0c05b6d247 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.048444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.049124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.049408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.049685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] PATH_INFO: `/v3/users/4faf793d114b4e3ba30256d21cedf6a3` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.050966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] RBAC: Authorizing `identity:get_user(user_id=4faf793d114b4e3ba30256d21cedf6a3)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.052548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.054232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 564/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:15 2022] GET /identity/v3/users/4faf793d114b4e3ba30256d21cedf6a3 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.060950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.149444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.164648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0022d-c081-49e1-885d-706ebb929f9d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.198801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf2e5a-8d15-4b2f-a125-07927c943a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.199458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2e5a-8d15-4b2f-a125-07927c943a4d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.199737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2e5a-8d15-4b2f-a125-07927c943a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.200010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2e5a-8d15-4b2f-a125-07927c943a4d None admin] PATH_INFO: `/v3/projects/d6f94831005849cfa4b2dfda4e6d085c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.201259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2e5a-8d15-4b2f-a125-07927c943a4d None admin] RBAC: Authorizing `identity:get_project(project_id=d6f94831005849cfa4b2dfda4e6d085c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.202637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2e5a-8d15-4b2f-a125-07927c943a4d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.204356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 588/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:16 2022] GET /identity/v3/projects/d6f94831005849cfa4b2dfda4e6d085c => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:16.210626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:16.236137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:16.321945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca133-1894-4191-b956-b3418bac00f4 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:16.363618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5d53b-becc-4e10-b5ef-71d1fb48bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:16.364377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d53b-becc-4e10-b5ef-71d1fb48bfab None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:16.364769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d53b-becc-4e10-b5ef-71d1fb48bfab None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:16.365072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5d53b-becc-4e10-b5ef-71d1fb48bfab None admin] PATH_INFO: `/v3/projects/d6f94831005849cfa4b2dfda4e6d085c/users/4faf793d114b4e3ba30256d21cedf6a3/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:16.367365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5d53b-becc-4e10-b5ef-71d1fb48bfab None admin] RBAC: Authorizing `identity:create_grant(project_id=d6f94831005849cfa4b2dfda4e6d085c, user_id=4faf793d114b4e3ba30256d21cedf6a3, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:16.369026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5d53b-becc-4e10-b5ef-71d1fb48bfab None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:16.383868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 565/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:16 2022] PUT /identity/v3/projects/d6f94831005849cfa4b2dfda4e6d085c/users/4faf793d114b4e3ba30256d21cedf6a3/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:14:18.640007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ccc7a-9417-4c73-b89b-d7583e19dea0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.640598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ccc7a-9417-4c73-b89b-d7583e19dea0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.640712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ccc7a-9417-4c73-b89b-d7583e19dea0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.642154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 589/1154] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:18.647929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.648422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.648532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.668479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:18.669725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:18.755432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 566/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:18.780091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ccc7a-9417-4c73-b89b-d7583e19dea0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.898567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ccc7a-9417-4c73-b89b-d7583e19dea0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:18.938394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:18.939130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:18.939417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:18.939712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:18.952949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:18.960024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:18.961424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:14:18.962686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 590/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:18.968671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:18.985654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.077317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afee4f-9522-47de-bc1d-e0daf71a9927 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.117685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.118329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.118607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.118880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.119641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:19.119943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.121427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.131322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 567/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:19.138311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.157618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.265332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d28b4-c9dd-44bf-981d-9bd2ed54a3bf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.309494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.310135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.310411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.310678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] PATH_INFO: `/v3/users/4faf793d114b4e3ba30256d21cedf6a3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.311911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] RBAC: Authorizing `identity:get_user(user_id=4faf793d114b4e3ba30256d21cedf6a3)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.313373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.315036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 591/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/users/4faf793d114b4e3ba30256d21cedf6a3 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:19.321520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.411109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.437133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438e575-78d1-42c6-8789-8bfdc83a2142 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.479746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.480407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.480999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.481322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.561081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.562573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.653082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.678905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 568/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:19.685390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.780542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:19.805085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1d732-c24d-46d4-9a67-e9e1f6829443 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:19.846600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72da84-2377-41aa-9fc3-0bc5c37dcf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:19.847310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72da84-2377-41aa-9fc3-0bc5c37dcf65 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:19.847590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72da84-2377-41aa-9fc3-0bc5c37dcf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:19.847999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72da84-2377-41aa-9fc3-0bc5c37dcf65 None admin] PATH_INFO: `/v3/projects/d6f94831005849cfa4b2dfda4e6d085c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:19.849296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72da84-2377-41aa-9fc3-0bc5c37dcf65 None admin] RBAC: Authorizing `identity:get_project(project_id=d6f94831005849cfa4b2dfda4e6d085c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:19.850724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72da84-2377-41aa-9fc3-0bc5c37dcf65 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:19.852414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 592/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/projects/d6f94831005849cfa4b2dfda4e6d085c => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:19.859659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:19.968072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85fa9f-928c-4ab8-84d3-8c10b47a758a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:20.014890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:20.015541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:20.015878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:20.016171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:20.017071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=d6f94831005849cfa4b2dfda4e6d085c, user.id=4faf793d114b4e3ba30256d21cedf6a3) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:20.017388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:20.018926 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea2c5c-4cbd-40b7-b9dd-07ca50d931ee None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:20.026064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 569/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:19 2022] GET /identity/v3/role_assignments?user.id=4faf793d114b4e3ba30256d21cedf6a3&scope.project.id=d6f94831005849cfa4b2dfda4e6d085c&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:22.303121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183615fd-06d3-43fe-b65c-467caad55099 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.303694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183615fd-06d3-43fe-b65c-467caad55099 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.303694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183615fd-06d3-43fe-b65c-467caad55099 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.305098 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 593/1162] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:22.315029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.315610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.315610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.335863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:22.337141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:22.378344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:22.424464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 570/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:14:22.448730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183615fd-06d3-43fe-b65c-467caad55099 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:22.563225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183615fd-06d3-43fe-b65c-467caad55099 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:22.599339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:22.599957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.600239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.600508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.623296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:22.681359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:22.683379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:22.789337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 594/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:22.798118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:22.913950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423ce6-d1c5-4e20-a045-bc7cba067d9d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:22.953831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:22.954576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:22.954868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:22.955189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:22.962939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:22.964658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-d12d1dc3-e15c-4bea-b38d-2f49b55fa82d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:22.977138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:22.978991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:14:22.980078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 571/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:14:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:22.986528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:23.054671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:23.112584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b79837-b361-4473-bbdb-71e79e48b480 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:23.152404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:23.153171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:23.153574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:23.153883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:23.154707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:23.155134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:23.156917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0fd5c-fd62-4fc2-b0a2-41a3171cf5d3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:23.166536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 595/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Jul 26 10:14:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:25.292158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a331e-cf50-4601-a062-7d427d2b8f2f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.292687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a331e-cf50-4601-a062-7d427d2b8f2f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.292687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a331e-cf50-4601-a062-7d427d2b8f2f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.293994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 572/1167] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:25.299348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aceb0c-be29-463f-ae8a-4a48f542183d None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.299740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aceb0c-be29-463f-ae8a-4a48f542183d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.299907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aceb0c-be29-463f-ae8a-4a48f542183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.318080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-77aceb0c-be29-463f-ae8a-4a48f542183d None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:25.319259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-77aceb0c-be29-463f-ae8a-4a48f542183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:25.385817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 596/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:25.408537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a331e-cf50-4601-a062-7d427d2b8f2f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:25.437883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:25.530489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a331e-cf50-4601-a062-7d427d2b8f2f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:25.562772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01919d72-64da-49a3-86e2-607175384591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:25.563312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919d72-64da-49a3-86e2-607175384591 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:25.563588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919d72-64da-49a3-86e2-607175384591 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:25.563858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01919d72-64da-49a3-86e2-607175384591 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:25.564549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01919d72-64da-49a3-86e2-607175384591 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:25.565922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01919d72-64da-49a3-86e2-607175384591 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:25.581710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 573/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Jul 26 10:14:25 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:27.664462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9946-dd1e-4606-9f07-eda48c356625 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.665037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9946-dd1e-4606-9f07-eda48c356625 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.665037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9946-dd1e-4606-9f07-eda48c356625 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.666436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 597/1170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:27.671811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.672236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.672355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.690073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:27.691271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:27.762767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 574/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:27.785672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9946-dd1e-4606-9f07-eda48c356625 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:27.831623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:27.888939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9946-dd1e-4606-9f07-eda48c356625 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:27.924876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a05bca-e392-4628-a8ad-08eab0e6fd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:27.925460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05bca-e392-4628-a8ad-08eab0e6fd03 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:27.925740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05bca-e392-4628-a8ad-08eab0e6fd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:27.926018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a05bca-e392-4628-a8ad-08eab0e6fd03 None admin] PATH_INFO: `/v3/domains/d27fd163d8f94cbca28801248f7b0e3a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:27.938124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a05bca-e392-4628-a8ad-08eab0e6fd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d27fd163d8f94cbca28801248f7b0e3a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:27.939589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a05bca-e392-4628-a8ad-08eab0e6fd03 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:27.941351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 598/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jul 26 10:14:27 2022] GET /identity/v3/domains/d27fd163d8f94cbca28801248f7b0e3a => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:27.947918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:27.968604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:28.044749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6524f4-fc3f-4282-8487-137a2c3e27ae None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:28.078241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aef39f-558d-4b57-9d50-0ad7e852d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:28.078854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aef39f-558d-4b57-9d50-0ad7e852d699 None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:28.079133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aef39f-558d-4b57-9d50-0ad7e852d699 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:28.079403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aef39f-558d-4b57-9d50-0ad7e852d699 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:28.080083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aef39f-558d-4b57-9d50-0ad7e852d699 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:28.081540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aef39f-558d-4b57-9d50-0ad7e852d699 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:28.106989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 575/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:14:27 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:30.161363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ace21-ac67-492d-a6ba-91e5a6ce20f4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.161918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ace21-ac67-492d-a6ba-91e5a6ce20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.161918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ace21-ac67-492d-a6ba-91e5a6ce20f4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.163366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 599/1174] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:30.168535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.168987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.169119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.187472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:30.188670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:30.254729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 576/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:30.280047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ace21-ac67-492d-a6ba-91e5a6ce20f4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.379316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ace21-ac67-492d-a6ba-91e5a6ce20f4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.381615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.412696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df3327-0697-46be-b260-0db063f124d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.413353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df3327-0697-46be-b260-0db063f124d8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.413632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df3327-0697-46be-b260-0db063f124d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.413906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df3327-0697-46be-b260-0db063f124d8 None admin] PATH_INFO: `/v3/domains/d27fd163d8f94cbca28801248f7b0e3a` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.415050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df3327-0697-46be-b260-0db063f124d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d27fd163d8f94cbca28801248f7b0e3a)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.416491 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df3327-0697-46be-b260-0db063f124d8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.418114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 600/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Jul 26 10:14:30 2022] GET /identity/v3/domains/d27fd163d8f94cbca28801248f7b0e3a => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:30.423932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:30.426154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:30.533258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdaa6a-665a-4d05-bc6c-b99b6b0a5775 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:30.565524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d63e84-a030-4876-bc9c-671ace41c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:30.566132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63e84-a030-4876-bc9c-671ace41c9fa None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:30.566412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63e84-a030-4876-bc9c-671ace41c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:30.566688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d63e84-a030-4876-bc9c-671ace41c9fa None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:30.567361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63e84-a030-4876-bc9c-671ace41c9fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:30.568796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d63e84-a030-4876-bc9c-671ace41c9fa None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:30.589920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 577/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:14:30 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:14:32.671288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ff1e-473a-49f1-bcec-cdfadfae3abd None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:32.671854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ff1e-473a-49f1-bcec-cdfadfae3abd None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:32.671854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4ff1e-473a-49f1-bcec-cdfadfae3abd None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:32.673203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 601/1178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:32.678846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:32.679390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:32.679390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:32.699038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:32.700263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:32.757721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:32.772552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 578/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:32.796573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ff1e-473a-49f1-bcec-cdfadfae3abd None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:32.906956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4ff1e-473a-49f1-bcec-cdfadfae3abd None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:32.944760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:32.945350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:32.945634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:32.945909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:32.957287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:32.962223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:32.963420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:14:32.964294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 602/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:32.970999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.072018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15f34b-22ce-4f8a-9bf0-4e002c88abd0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.109105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.109738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.110019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.110293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.111010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:33.111315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.112704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.121563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 579/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:33.127424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.160594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.235143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7521e-56e1-431f-a2ae-2e04e24feedf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.270161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.270810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.271092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.271367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] PATH_INFO: `/v3/users/1cc9c87a8bee4b67949295c69b8ed40d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.285674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] RBAC: Authorizing `identity:get_user(user_id=1cc9c87a8bee4b67949295c69b8ed40d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.287127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.288867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 603/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/users/1cc9c87a8bee4b67949295c69b8ed40d => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:33.295332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.346189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.397477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc128f-b35c-445c-965b-4d46bda2e013 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.431753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.432371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.432655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.432957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.504167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.505563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.555781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.609322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 580/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:33.615332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.709044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:33.722397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd890b9-021c-4723-8460-145fcf4721c3 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.761160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b82c85-d145-4512-8bee-9b1ae5aca0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.761718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82c85-d145-4512-8bee-9b1ae5aca0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.761994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82c85-d145-4512-8bee-9b1ae5aca0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.762263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b82c85-d145-4512-8bee-9b1ae5aca0b5 None admin] PATH_INFO: `/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.763469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82c85-d145-4512-8bee-9b1ae5aca0b5 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef2a9a8931444b0897ad4ba55a6d26c)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.764953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b82c85-d145-4512-8bee-9b1ae5aca0b5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.767548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 604/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:33.773924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:33.881995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbe205-46cc-4265-8885-66db387adc13 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:33.916475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:33.917113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:33.917393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:33.917661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:33.918443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=7ef2a9a8931444b0897ad4ba55a6d26c, user.id=1cc9c87a8bee4b67949295c69b8ed40d) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:33.918749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:33.920174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1d2c9-97b2-4f2b-a72b-ef6c5f1fb8b8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:33.925911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 581/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:33 2022] GET /identity/v3/role_assignments?user.id=1cc9c87a8bee4b67949295c69b8ed40d&scope.project.id=7ef2a9a8931444b0897ad4ba55a6d26c&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:35.913441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddd9c2-a214-4f87-8f57-d3401a07a600 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:35.914007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddd9c2-a214-4f87-8f57-d3401a07a600 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:35.914007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fddd9c2-a214-4f87-8f57-d3401a07a600 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:35.915315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 605/1186] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:35.920871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:35.921307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:35.921413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:35.939619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:35.940799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:35.949943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:36.006111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 582/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:36.028824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddd9c2-a214-4f87-8f57-d3401a07a600 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.129315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fddd9c2-a214-4f87-8f57-d3401a07a600 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.165013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.166195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.166475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.166743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.177052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:36.181929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:36.184466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:14:36.186941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 606/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:36.189464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.291916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9d9a-0167-405e-b046-b0f006e16738 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.326049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.326664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.326959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.327218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.327928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:36.328228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:36.329630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:36.338702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 583/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:36.344692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.366683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:36.455953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fc365-a161-4444-820c-b967fa7084f1 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.496295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.496995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.497274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.497547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] PATH_INFO: `/v3/users/1cc9c87a8bee4b67949295c69b8ed40d` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.498855 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] RBAC: Authorizing `identity:get_user(user_id=1cc9c87a8bee4b67949295c69b8ed40d)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:36.501216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:36.502446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 607/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:36 2022] GET /identity/v3/users/1cc9c87a8bee4b67949295c69b8ed40d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:36.509805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.520547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:36.626333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a233822-203b-49c8-a9cb-e7f491ba9238 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.660758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2591d11-1271-4376-b92e-23038eb59748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.661440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2591d11-1271-4376-b92e-23038eb59748 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.661721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2591d11-1271-4376-b92e-23038eb59748 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.661992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2591d11-1271-4376-b92e-23038eb59748 None admin] PATH_INFO: `/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.663158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2591d11-1271-4376-b92e-23038eb59748 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef2a9a8931444b0897ad4ba55a6d26c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:36.664585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2591d11-1271-4376-b92e-23038eb59748 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:36.666362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 584/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:36 2022] GET /identity/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:36.672427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:36.759634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:36.776138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b80dd-4b72-4c67-b24b-7080b0191853 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:36.810189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7603d-1499-4a00-a99c-ec006c1c9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:36.810868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7603d-1499-4a00-a99c-ec006c1c9b36 None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:36.811150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7603d-1499-4a00-a99c-ec006c1c9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:36.811424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7603d-1499-4a00-a99c-ec006c1c9b36 None admin] PATH_INFO: `/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c/users/1cc9c87a8bee4b67949295c69b8ed40d/roles/2b446efbd008435f977d0068496eb403` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:36.813413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7603d-1499-4a00-a99c-ec006c1c9b36 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ef2a9a8931444b0897ad4ba55a6d26c, user_id=1cc9c87a8bee4b67949295c69b8ed40d, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:36.814845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e7603d-1499-4a00-a99c-ec006c1c9b36 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:36.827940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 608/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:14:36 2022] PUT /identity/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c/users/1cc9c87a8bee4b67949295c69b8ed40d/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:14:38.846719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55874-7e8e-48cb-bf9a-da35a5089acc None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.847263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55874-7e8e-48cb-bf9a-da35a5089acc None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.847263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c55874-7e8e-48cb-bf9a-da35a5089acc None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.848587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 585/1193] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:14:38.854086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:38.854560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:38.854647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:38.872828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:14:38.874075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:14:38.939031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 609/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:14:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:14:38.963603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55874-7e8e-48cb-bf9a-da35a5089acc None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.038963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.073648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c55874-7e8e-48cb-bf9a-da35a5089acc None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.108453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.109033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.109311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.109580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.120644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:14:39.125567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:14:39.126735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:14:39.127607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 586/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:14:39.132950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.214310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.239449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb631ce9-7a00-4fbe-b8f9-04b603b319a9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.276603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.277260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.277546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.277823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.278549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:39.278858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.280233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.288630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 610/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:39.294959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.400156 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b75fac9-6847-4af7-a653-2f393045c095 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.435850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.436496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.436773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.437072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] PATH_INFO: `/v3/users/1cc9c87a8bee4b67949295c69b8ed40d` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.438236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] RBAC: Authorizing `identity:get_user(user_id=1cc9c87a8bee4b67949295c69b8ed40d)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.439690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.441410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 587/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/users/1cc9c87a8bee4b67949295c69b8ed40d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:39.448559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.565109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122e68-2147-4655-8a5c-b0aed609d58b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.599276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.599895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.600171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.600439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.610335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.670888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.672249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.773782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 611/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:14:39.780325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.783238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:39.888695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2ff77-6f75-40c1-88bc-eb2d3953b392 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:39.924445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581eba4-590a-406b-b016-bf3df907dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:39.925034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581eba4-590a-406b-b016-bf3df907dc16 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:39.925311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581eba4-590a-406b-b016-bf3df907dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:39.925580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581eba4-590a-406b-b016-bf3df907dc16 None admin] PATH_INFO: `/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:39.926721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581eba4-590a-406b-b016-bf3df907dc16 None admin] RBAC: Authorizing `identity:get_project(project_id=7ef2a9a8931444b0897ad4ba55a6d26c)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:39.928152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581eba4-590a-406b-b016-bf3df907dc16 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:39.929837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 588/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/projects/7ef2a9a8931444b0897ad4ba55a6d26c => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:39.936016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:14:39.974723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:40.033151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1cc0f1-b05d-4f87-bdb1-b6dd7ea91bd5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:14:40.067254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:14:40.067873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:14:40.068151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:14:40.068421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:14:40.069251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=7ef2a9a8931444b0897ad4ba55a6d26c, user.id=1cc9c87a8bee4b67949295c69b8ed40d) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:14:40.069556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:14:40.071004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667642-659d-4609-a5b8-bf25bd8cb6c8 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:14:40.076875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 612/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:14:39 2022] GET /identity/v3/role_assignments?user.id=1cc9c87a8bee4b67949295c69b8ed40d&scope.project.id=7ef2a9a8931444b0897ad4ba55a6d26c&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:14:49.920184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=65 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:14:50.074213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=49 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:36.613668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b972438-26cf-4a0c-ba1b-f5fac4e71d72 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:36.614601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b972438-26cf-4a0c-ba1b-f5fac4e71d72 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:36.614601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b972438-26cf-4a0c-ba1b-f5fac4e71d72 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:36.618231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 589/1201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:15:36.622044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:36.622588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:36.622987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:36.652905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:36.652905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:36.773533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 613/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:15:36.793843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b972438-26cf-4a0c-ba1b-f5fac4e71d72 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:36.949987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b972438-26cf-4a0c-ba1b-f5fac4e71d72 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:37.001714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:37.002804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:37.003307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:37.003799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:37.024261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:37.027043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:37.056721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:37.058022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:37.059007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:37.059007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:37.059007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:37.059007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:37.065035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 590/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:37.067880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:37.229664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b66b-2865-49f0-8a5d-4589fd7b8423 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:37.294434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:37.305442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:37.306494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:37.306974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:37.307438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:37.308675 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:37.309287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:37.311796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79855e8c-f8ec-40dc-bd80-730fbc7dc972 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:37.341570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 614/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:15:37.343455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:37.426680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:37.503053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e726e-68eb-43ed-a63d-5d660f3e5689 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:37.551513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7616a7-5787-4439-a227-cf526d35c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:37.552148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7616a7-5787-4439-a227-cf526d35c5df None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:37.552423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7616a7-5787-4439-a227-cf526d35c5df None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:37.552692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7616a7-5787-4439-a227-cf526d35c5df None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:37.553419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7616a7-5787-4439-a227-cf526d35c5df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:37.554971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7616a7-5787-4439-a227-cf526d35c5df None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:37.578157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 591/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Jul 26 10:15:37 2022] POST /identity/v3/users => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:15:39.741723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90d70-df19-4a84-9303-225db4e1caa5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:39.742307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90d70-df19-4a84-9303-225db4e1caa5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:39.742715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac90d70-df19-4a84-9303-225db4e1caa5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:39.745610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 615/1206] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:15:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:15:39.753332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:39.753951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:39.754078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:39.778662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:39.780444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:39.875847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 592/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:15:39.901406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90d70-df19-4a84-9303-225db4e1caa5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:40.037355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac90d70-df19-4a84-9303-225db4e1caa5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:40.086819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:40.087594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:40.087954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:40.088237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:40.114904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:15:40.121089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:40.122345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:15:40.123353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:40.125574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 616/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:15:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:40.133848 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:40.193991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:40.266820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c1449-08ae-4c4b-b057-921945b5ded4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:40.321343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:40.322213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:40.322502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:40.322775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:40.323703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:40.324014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:40.325658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:40.335187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 593/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:40.342042 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:40.402609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:40.465506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada922b-9af8-45ce-8159-b21872e30df8 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:40.512799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:40.513520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:40.513844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:40.514068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:40.526732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:40.528195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:40.544052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:40.545268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:40.546186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:40.546186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:40.546186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:40.546186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:40.550075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 617/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:40.551487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:40.666441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:40.670128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe759-fdcb-4918-a60b-0f153355d0cc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:40.713424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:40.714043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:40.714340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:40.714619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:40.715322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:40.715627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:40.717054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:40.733028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 594/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:40.737314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:40.847760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbf886-d5e9-4518-9e33-212a48f5fd23 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:40.850330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:40.886419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:40.887437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:40.887936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:40.888191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:40.900777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:40.902271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:15:40.914819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:40.916118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:40.917175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:40.921147 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 618/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:40.922223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:41.070496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72ee06-b452-4089-ad0b-3ad36fc51815 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:41.120487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:41.121334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:41.121691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:41.121965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:41.123195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:41.123574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:41.125473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:41.149482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 595/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 10:15:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:41.155267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:41.285045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d174fa-a2b4-4193-b853-ee49c5fdda41 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:41.331439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:41.332666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:41.333169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:41.335435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:41.389453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:41.446837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:41.448390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:41.570966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 619/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:15:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:15:41.577088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:41.597406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:41.694096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a84d2-b821-43ad-a0fa-7f4a4ef46eab None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:41.742359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:41.743077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:41.743412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:41.743634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:41.755971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:41.757641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:41.774979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:41.776249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:41.777428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:41.777428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:41.777428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:41.777428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:41.781062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 596/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:41.783993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:41.857431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:41.902031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f867ff-2122-4ffc-b56e-19f8e946ebdf None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:41.943929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:41.947055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:41.947055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:41.947055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:41.947055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:41.947055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:41.949085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:41.960666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 620/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:41.966629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:42.065226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:42.109513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c814166-71fd-4fc2-b13f-c6310582feb9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:42.154174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:42.155030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:42.155405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:42.155743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:42.165467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:42.167178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:15:42.183084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:42.184126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:42.185340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 597/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:15:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:42.194528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:42.324749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9e103-6883-417e-b44b-09f8875bf26b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:42.350004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:42.365731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:42.366300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:42.366588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:42.366862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:42.367640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:42.367938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:42.369423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aad507-0473-4ec1-a423-695fbe051624 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:42.384796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 621/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:42.391193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:42.539314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7365-5b03-428f-afe0-c571e8df2ede None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:42.573712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:42.581463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:42.582047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:42.582340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:42.582617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:42.583470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=cb74cb8c3eb34807b834367ccf09278b) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:42.583821 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:42.585385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7318408-02e6-4196-b505-4cddea981c94 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:42.592515 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 598/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:15:42 2022] GET /identity/v3/role_assignments?user.id=cb74cb8c3eb34807b834367ccf09278b&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:44.734893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1edd79-4b7f-43e5-9f57-d4ec7604e613 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:44.735444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1edd79-4b7f-43e5-9f57-d4ec7604e613 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:44.735444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1edd79-4b7f-43e5-9f57-d4ec7604e613 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:44.736916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 622/1220] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:15:44.743240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:44.743742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:44.743833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:44.763254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:44.764586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:44.861403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 599/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:15:44.886697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1edd79-4b7f-43e5-9f57-d4ec7604e613 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:45.030407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1edd79-4b7f-43e5-9f57-d4ec7604e613 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:45.072956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:45.073718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:45.074072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:45.074351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:45.089081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:15:45.094770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:45.095960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:45.097151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 623/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:15:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:45.104022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:45.235373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92077bba-70bd-42d4-8938-e5299284c140 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:45.266856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:45.279775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:45.280401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:45.280728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:45.282733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:45.282733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:45.282733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:45.283516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:45.294273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 600/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:45.298840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:45.349346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:45.411128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15850d-d180-4fa1-ad87-1db65b84be38 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:45.449805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:45.450498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:45.450738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:45.451414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:45.464925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:45.466710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:45.482638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:45.483669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:45.484618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:45.484618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:45.484618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:45.484618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:45.484618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 624/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:45.490021 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:45.601306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97747c-c1b2-4a65-add4-f312383adbe3 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:45.641492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:45.642247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:45.642483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:45.642753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:45.643529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:45.643886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:45.645324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:45.660754 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 601/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:45.668483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:45.791017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:45.798494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6109030-598f-475e-8eb2-1b15f4f5e4c4 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:45.841549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:45.842346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:45.842734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:45.843158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:45.856037 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:45.858604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:15:45.880658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:45.881897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:45.882871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 625/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:45.890939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:45.945832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:46.008546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee170a1-334b-433e-a593-f654e7f16f91 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:46.047687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:46.048358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:46.048630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:46.048936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:46.049737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:46.050069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:46.051577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:46.072598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 602/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 10:15:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:46.078430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:46.194801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7609-ce53-48eb-b6d7-d50851529096 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:46.237880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:46.238769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:46.239187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:46.239605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:46.258726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:46.261436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:46.287879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:46.289884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:46.291684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:46.291684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:46.291684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:46.291684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:46.291684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 626/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:46.299351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:46.420076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d77d-b2fd-49c3-ae46-83dbdbab9a42 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:46.423108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:46.477589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:46.478553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:46.479032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:46.479390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:46.480569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:46.481186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:46.483070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:46.507249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 603/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:46.514246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:46.525301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:46.656603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00033ec-2197-4d36-9944-93c81f604728 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:46.699501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:46.700578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:46.701277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:46.702079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:46.714791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:46.716722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:15:46.733060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:46.734933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:46.736909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 627/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:15:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:46.741033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:46.875877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1f04f-4937-477c-9b22-32420a1ca4ba None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:46.918758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:46.919468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:46.919889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:46.920359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:46.921487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:46.921924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:46.923911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3b3ca-c441-4f75-a18c-73505f322f81 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:46.944251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 604/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:15:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:46.956280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:47.049503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:47.103610 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198ef99-2cea-44f8-b520-64cf4a371f79 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:47.148389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d220f-b034-426d-979a-eeea96f0e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:47.149185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d220f-b034-426d-979a-eeea96f0e81e None admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:47.149472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d220f-b034-426d-979a-eeea96f0e81e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:47.149751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d220f-b034-426d-979a-eeea96f0e81e None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/cb74cb8c3eb34807b834367ccf09278b/roles/a914e8544e6b43fba36c4b0f2ee54610` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:47.167278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d220f-b034-426d-979a-eeea96f0e81e None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=cb74cb8c3eb34807b834367ccf09278b, role_id=a914e8544e6b43fba36c4b0f2ee54610)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:47.169013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d220f-b034-426d-979a-eeea96f0e81e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:47.183597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 628/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:15:46 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/cb74cb8c3eb34807b834367ccf09278b/roles/a914e8544e6b43fba36c4b0f2ee54610 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:15:49.321484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9824c0-42d2-4db4-b033-8ffc594b66fe None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:49.322351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9824c0-42d2-4db4-b033-8ffc594b66fe None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:49.322351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9824c0-42d2-4db4-b033-8ffc594b66fe None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:49.323320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 605/1233] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:15:49.332654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:49.332654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:49.332654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:49.356168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:49.357986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:49.451284 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 629/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 10:15:49.475586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9824c0-42d2-4db4-b033-8ffc594b66fe None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:49.504896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:49.597475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9824c0-42d2-4db4-b033-8ffc594b66fe None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:49.634508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:49.635174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:49.635453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:49.635745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:49.648348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:15:49.653889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:49.654930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:49.656071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 606/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Jul 26 10:15:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:49.661895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:49.717309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:49.790776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb25501-4c38-41b8-8b92-a58bbbca7ce3 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:49.828149 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:49.828783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:49.829091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:49.829362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:49.830094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] RBAC: Adding query filter params (name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:49.830398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:49.831775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:49.841071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 630/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Jul 26 10:15:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:49.847299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:49.941737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:49.959082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d698ce-15fe-4ed0-a4f7-aae5a6150be7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:50.000441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:50.001171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:50.001446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:50.001722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:50.013715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:50.015197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:50.034958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:50.036192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:50.037354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:50.037354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:50.037354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:50.037354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:50.037354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 607/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:50.042311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:50.147400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d2030-05ee-4d44-a6a1-e71666d90552 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:50.159099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:50.193721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:50.194313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:50.195206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:50.195479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:50.196264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:50.196623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:50.198050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:50.218388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 631/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:50.219908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:50.344484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bcff5-ef7a-4b91-83b9-5a0e573d7203 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:50.386790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:50.387352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:50.387690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:50.387951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:50.393591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:50.397470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:50.399164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:15:50.412177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:50.413665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:50.414904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 608/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:50.419898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:50.554822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b01a1-1c1f-4068-9c55-0fc631621dd0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:50.605220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:50.606116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:50.606408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:50.606695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:50.607845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:50.608198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:50.610095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:50.636338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 632/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 10:15:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:50.642343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:50.769443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168df86-698c-40eb-8cc2-9031ad09cb6c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:50.813084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:50.813861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:50.814484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:50.814934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:50.894383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:50.903757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:50.905455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:51.031275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 609/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:15:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:15:51.039345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:51.070753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:51.157452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef975a-667c-411f-ac3b-3fe0ace13ced None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:51.202267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:51.202928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:51.203208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:51.203532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:51.216045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:51.217795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:51.238997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:51.240022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:51.241052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:51.241052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:51.241052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:51.241052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:51.241052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 633/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:51.246679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:51.368946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:51.378278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a01b0-b059-46bb-9622-96363d33e073 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:51.425861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:51.426562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:51.426841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:51.427117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:51.427905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:51.428223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:51.430375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:51.444549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 610/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:51.452672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:51.555852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:51.579401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571bd1f-82e3-4cc5-afad-560b4787d531 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:51.623018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:51.623796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:51.624258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:51.624678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:51.638618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:51.639783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:15:51.654798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:51.655910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:51.656884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 634/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:51.661721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:51.787866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bb163-bc0b-4ddd-87ee-e730678a7dbd None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:51.826714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:51.827563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:51.827859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:51.828204 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:51.829304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:51.829730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:51.831420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fcb36-e1ca-4fe2-8487-9d8c40415a55 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:51.850674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 611/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:15:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:51.852969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:51.989385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966cff-7ab3-4fbf-adb5-f92c281d51a0 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:52.029918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:52.030548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:52.030827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:52.031159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:52.031948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] RBAC: Adding query filter params (role.id=a914e8544e6b43fba36c4b0f2ee54610, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=cb74cb8c3eb34807b834367ccf09278b) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:52.032393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:52.033902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89c2ef-7e28-409d-85de-9f21189fc63e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:52.041654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 635/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:15:51 2022] GET /identity/v3/role_assignments?user.id=cb74cb8c3eb34807b834367ccf09278b&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=a914e8544e6b43fba36c4b0f2ee54610 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:54.284934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039d0e-7228-4e19-bd42-efa1450c0515 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:54.286552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039d0e-7228-4e19-bd42-efa1450c0515 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:54.286552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d039d0e-7228-4e19-bd42-efa1450c0515 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:54.286764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 612/1247] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:15:54.292761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:54.293261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:54.293661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:54.301668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:54.318046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:54.320331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:54.416941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 636/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:15:54.438647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039d0e-7228-4e19-bd42-efa1450c0515 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:54.460770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:54.585986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d039d0e-7228-4e19-bd42-efa1450c0515 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:54.629857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:54.630556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:54.630798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:54.631096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:54.646535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:15:54.654343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:54.656031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:54.657144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 613/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:54.662432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:54.784890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b370b88-cc14-4a70-9dad-36778667c153 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:54.822158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:54.829639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:54.830525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:54.830827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:54.831074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:54.831903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:54.832201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:54.833800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:54.844620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 637/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:54.851338 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:54.954803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:54.987534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432da0be-32e5-4698-8569-b4c814673d5c None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:55.029921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:55.030638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:55.030917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:55.031187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:55.044311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:55.045993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:55.066427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:55.067590 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:55.068649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:55.068649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:55.068649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:55.068649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:55.068649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 614/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:55.075713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:55.206214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b19835-118d-4bb1-8a61-dad2de4e66a5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:55.247143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:55.247891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:55.248175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:55.248537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:55.249496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:55.249968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:55.251879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:55.270146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 638/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:55.277381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:55.395788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9421-d499-4655-8c6a-eadfc42827f9 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:55.428647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:55.438579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:55.439462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:55.439751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:55.440022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:55.450393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:55.452161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:15:55.466796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:55.468019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:55.469267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 615/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:55.474083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:55.535637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:55.587850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473edfa-ee40-4d76-a6f1-cbf92edb1f6c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:55.628109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:55.628864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:55.629194 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:55.629464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:55.630379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:55.630706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:55.632403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:55.653365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 639/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 10:15:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:55.660084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:55.790071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d78d6f-c234-48e8-9fd7-980eb516ddeb None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:55.837455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:55.838131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:55.838406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:55.838647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:55.916452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:55.930408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:55.931884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:56.054922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 616/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:15:56.061311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:56.187544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a4a17-1236-4f0d-ae52-189912b4c53c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:56.205534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:56.236065 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:56.236957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.237327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.237633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.251068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:56.252734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:56.273677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:56.275108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:56.276177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:56.276177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:56.276177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:56.276177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:56.276177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 640/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:15:56.282054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:56.423831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:56.440662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501ad7e-f310-4a3e-babb-2f82834e0670 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:56.492054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:56.492688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.493006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.493282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.493992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:56.494291 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:56.495697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:56.515116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 617/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:56.521386 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:56.660444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471b0d3-516b-40d6-8310-ff5435a8c9fa None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:56.720340 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:56.720942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.721236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.721511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.729145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:56.730902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:15:56.743944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:56.745734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:15:56.747509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 641/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:56.753310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:56.921516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e55452-5073-43de-925a-2410fbb002ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:56.969035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:56.969968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:56.970560 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:56.970807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:56.971865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:56.972199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:56.974805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba8691-e316-46a5-9fd0-b9769cbf0b35 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:56.993987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 618/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:57.000749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:57.037522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:57.136530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b3249-b996-47a1-9e2e-e113739b1ea5 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:57.181952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:57.182585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:57.182875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:57.183303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:57.183953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=cb74cb8c3eb34807b834367ccf09278b) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:57.184327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:57.185800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bafe4-7023-4f30-b3e4-af0920a4fa92 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:57.193532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 642/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:15:56 2022] GET /identity/v3/role_assignments?user.id=cb74cb8c3eb34807b834367ccf09278b&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=2b446efbd008435f977d0068496eb403 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:59.286704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d541e6-64f2-4be6-b6c5-1200c6a9bcf0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:59.287280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d541e6-64f2-4be6-b6c5-1200c6a9bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:59.287594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d541e6-64f2-4be6-b6c5-1200c6a9bcf0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:59.290196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 619/1261] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:15:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:15:59.297289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:59.298017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:59.298267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:59.318644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:15:59.319973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:15:59.391737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 643/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:15:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:15:59.414724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d541e6-64f2-4be6-b6c5-1200c6a9bcf0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:59.430023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:59.525553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d541e6-64f2-4be6-b6c5-1200c6a9bcf0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:59.560864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:59.561439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:59.561715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:59.561990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:59.574168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:15:59.579086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:59.580195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:59.581566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 620/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:59.586994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:59.609592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:59.692894 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e27087-fb5d-4357-8633-3e729f3d5812 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:59.730972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:59.731934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:59.732385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:59.732726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:59.733741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:15:59.734048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:59.736182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:59.747150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 644/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:15:59.752927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:15:59.823789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:15:59.858047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e60f0-2530-41cc-a6a5-cbed7f8f4749 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:15:59.897085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:15:59.898542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:15:59.898916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:15:59.899288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:15:59.914577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:15:59.916336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:15:59.932671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:15:59.933891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:15:59.934831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:15:59.934831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:15:59.934831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:15:59.934831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:15:59.934831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 621/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:15:59.940064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.034654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:00.054817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaa9c6-2a87-419d-8aa1-b5624569052c None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.088516 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.089175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.089451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.089728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.090431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:00.090730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.092093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.104033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 645/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:00.110280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.220924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd598b47-e3a9-4f24-900f-202e959859ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.252403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:00.269395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.270073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.270383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.270786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.280420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.281920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:00.293838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:00.295697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:16:00.296977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 622/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:00.300991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.405447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7cd88-88d5-473d-a5a3-213bf559757b None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.438702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.439321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.439602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.439875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.440671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:00.441004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.442430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.453296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:00.463244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 646/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:00.469002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.565054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65d59a-2ad0-41c1-85ac-b48c8cdff0dc None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.598552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.599183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.599459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.599729 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.611032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.612476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:00.626714 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:00.627827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:00.628981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:00.628981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:00.628981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:00.628981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:16:00.628981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 623/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:00.633660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.750351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b72e-2ea7-4d19-b60b-5af2fe64103e None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.792972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.793603 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.793883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.794193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.795005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:00.795308 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.796691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.808691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 647/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:00.814481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:00.846540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:00.916170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5eae21-aa53-42da-af2e-7de75fbcfe5e None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:00.948746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:00.949410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:00.949688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:00.949957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:00.956759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:00.958232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:00.969951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:00.971085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:16:00.972435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 624/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:00.977555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:01.036198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:01.082980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537de1-505e-4095-8862-624ff02795ea None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:01.123321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:01.123955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:01.124237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:01.124508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:01.125302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:01.125607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:01.127063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6c729-f704-4410-bb61-46d16f077c8f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:01.141401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 648/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:01.148711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:01.269383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:01.280288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0cd77-cb69-4727-a6cf-fd62e2371331 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:01.315307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170980f-d727-4910-a0e2-bf850e98a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:01.315966 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170980f-d727-4910-a0e2-bf850e98a591 None admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:01.316170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170980f-d727-4910-a0e2-bf850e98a591 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:01.316443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170980f-d727-4910-a0e2-bf850e98a591 None admin] PATH_INFO: `/v3/projects/10ce6f12e9694f959993f5381deee202/users/cb74cb8c3eb34807b834367ccf09278b/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:01.318562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170980f-d727-4910-a0e2-bf850e98a591 None admin] RBAC: Authorizing `identity:create_grant(project_id=10ce6f12e9694f959993f5381deee202, user_id=cb74cb8c3eb34807b834367ccf09278b, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:01.320645 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d170980f-d727-4910-a0e2-bf850e98a591 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:01.336126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 625/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Jul 26 10:16:01 2022] PUT /identity/v3/projects/10ce6f12e9694f959993f5381deee202/users/cb74cb8c3eb34807b834367ccf09278b/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:16:03.430373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fc32-9fab-46f9-a84b-9aac053a98ed None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:03.430970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fc32-9fab-46f9-a84b-9aac053a98ed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:03.430970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07fc32-9fab-46f9-a84b-9aac053a98ed None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:03.432272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 649/1274] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:16:03.437829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:03.438518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:03.438744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:03.458699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:03.460651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:03.539741 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 626/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:03.561577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fc32-9fab-46f9-a84b-9aac053a98ed None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:03.684908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07fc32-9fab-46f9-a84b-9aac053a98ed None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:03.707444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:03.729325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:03.730046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:03.730367 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:03.730683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:03.744270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 10:16:03.749470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:03.751245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:03.753090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 650/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Jul 26 10:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:03.760833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:03.859245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:03.884142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552f0a7-aca1-488e-a494-516a2db5ab63 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:03.930243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:03.931514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:03.931798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:03.932058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:03.933171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:03.933477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:03.934901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:03.953028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 627/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Jul 26 10:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:03.959734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:04.081064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6209c4f7-efb8-413f-8aaf-86f93910a363 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:04.141154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:04.142263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:04.142771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:04.143267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:04.172431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:04.175094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:04.208380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:04.210096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:04.212155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:04.212155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:04.212155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:04.212155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:04.212155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 651/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:04.218514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:04.375254 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a8f0-e0ee-496d-bacc-af2f530ce3ea None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:04.418466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:04.419081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:04.419356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:04.419623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:04.420311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:04.420606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:04.422023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:04.443200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 628/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:04.449767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:04.486859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:04.573029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6232d2-8536-4641-b056-24e1b4ab494f None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:04.610232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:04.611003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:04.611281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:04.611551 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:04.620559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:04.622056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 10:16:04.634668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:04.636451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:04.638303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 652/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:04.644756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:04.648892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:04.757376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67168-b43d-464f-8f4d-2e54d665cd23 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:04.797295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:04.797938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:04.798213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:04.798479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:04.799288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:04.799593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:04.801089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:04.822071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 629/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Jul 26 10:16:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:04.830948 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:04.936040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:04.947863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259156a9-7537-4d00-b59f-a6245a2e1959 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:04.984899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:04.985529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:04.985810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:04.986090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.058198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:05.059577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:05.149363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:05.160526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 653/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Jul 26 10:16:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 10:16:05.166963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:05.237166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:05.301405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1795-187a-4da4-9cdc-07870fb3b96a None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:05.358733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:05.359437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.359763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.360080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.371056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:05.372517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 10:16:05.387770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:05.389482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:05.391586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 10:16:05.391586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 10:16:05.391586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 10:16:05.391586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:16:05.391586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 630/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:05.396090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:05.501266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bac1d-de54-45d3-9c27-01798aecae48 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:05.537651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:05.538327 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.538609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.538884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.539573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:05.539876 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:05.541275 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:05.557746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 654/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:05.560499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:05.729219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007f350-f8a4-48e1-b61b-bb25c0d855d7 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:05.752920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:05.775417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:05.776073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.776347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.776614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.783994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:05.785479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 10:16:05.797154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:05.798846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: ERROR keystone.server.flask.application Jul 26 10:16:05.800621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 631/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:05.805751 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:05.861325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:05.918196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0c4ad-69ee-436d-bb1b-59c571993ad2 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:05.958424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:05.959068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:05.959347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:05.959617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:05.960431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:05.960740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:05.962238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb45ef-1c84-44b1-b573-4ea2deed060b None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:05.976470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 655/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:05.983496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:06.095950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ace45d-7569-4031-b6e8-bc69aced2f33 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:06.131287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:06.131971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:06.132250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:06.132520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:06.133339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] RBAC: Adding query filter params (role.id=2b446efbd008435f977d0068496eb403, scope.project.id=10ce6f12e9694f959993f5381deee202, user.id=cb74cb8c3eb34807b834367ccf09278b) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:06.133646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:06.135077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b80f7d-af0f-4223-a9eb-2bb2d124dee8 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:06.141413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 632/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Jul 26 10:16:05 2022] GET /identity/v3/role_assignments?user.id=cb74cb8c3eb34807b834367ccf09278b&scope.project.id=10ce6f12e9694f959993f5381deee202&role.id=2b446efbd008435f977d0068496eb403 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:08.296432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15b18-bf36-4e02-a18d-bd4b84562ce2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:08.297185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15b18-bf36-4e02-a18d-bd4b84562ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:08.297185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15b18-bf36-4e02-a18d-bd4b84562ce2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:08.298263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 656/1288] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:16:08.304514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:08.305152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:08.305298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:08.324990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:08.326186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:08.355320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:08.393699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 633/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:08.430680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15b18-bf36-4e02-a18d-bd4b84562ce2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:08.543210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15b18-bf36-4e02-a18d-bd4b84562ce2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:08.555951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:08.579600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:08.580242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:08.580520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:08.580789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:08.581448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:08.582811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:08.592253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:08.593613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:08.594546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 657/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:16:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:08.599626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:08.701852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d2bac-b0eb-499f-83c5-f28a6028b35e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:08.735908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:08.736532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:08.736832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:08.737130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:08.737802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:08.738103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:08.739471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ef7d-b36b-48a4-8f99-fa09e9383d98 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:08.744988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 634/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:08 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:08.750939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:08.854435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422495ae-6270-46f4-ad66-5660b338616d None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:08.888438 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:08.889092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:08.889377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:08.889648 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] PATH_INFO: `/v3/services` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:08.890336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:08.890637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:08.892019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a262d4d-a6ac-4587-9447-03d252a0d78d None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:08.896734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 658/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:08 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:10.949662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd5ffd-a98c-436f-b075-f400aa772071 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.950190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd5ffd-a98c-436f-b075-f400aa772071 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.950190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd5ffd-a98c-436f-b075-f400aa772071 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.951561 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 635/1293] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:16:10.957105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234301ca-2c5a-4e87-930d-c3ffb60d42c3 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:10.957528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234301ca-2c5a-4e87-930d-c3ffb60d42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:10.957656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234301ca-2c5a-4e87-930d-c3ffb60d42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:10.978269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-234301ca-2c5a-4e87-930d-c3ffb60d42c3 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:10.979466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-234301ca-2c5a-4e87-930d-c3ffb60d42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:11.010564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:11.057703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 659/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:11.080189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd5ffd-a98c-436f-b075-f400aa772071 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:11.112012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:11.186495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd5ffd-a98c-436f-b075-f400aa772071 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:11.221406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40481941-dbee-45b7-802a-6b192db8a80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:11.221962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40481941-dbee-45b7-802a-6b192db8a80e None admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:11.222242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40481941-dbee-45b7-802a-6b192db8a80e None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:11.222510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40481941-dbee-45b7-802a-6b192db8a80e None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:11.223217 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40481941-dbee-45b7-802a-6b192db8a80e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:11.224631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40481941-dbee-45b7-802a-6b192db8a80e None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:11.243911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 636/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Jul 26 10:16:11 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:16:13.284933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80137a-cd72-4bbe-91d2-bfa0f4c9d65c None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:13.285496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80137a-cd72-4bbe-91d2-bfa0f4c9d65c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:13.285641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80137a-cd72-4bbe-91d2-bfa0f4c9d65c None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:13.287319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 660/1296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:16:13.295513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:13.297024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:13.297314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:13.318682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:13.319924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:13.397461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 637/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:13.420808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80137a-cd72-4bbe-91d2-bfa0f4c9d65c None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:13.526995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80137a-cd72-4bbe-91d2-bfa0f4c9d65c None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:13.562521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:13.563070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:13.563350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:13.563623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:13.564244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:13.565631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:13.574774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:13.576584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:13.578336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 661/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:16:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 10:16:13.582070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:13.604773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:13.686541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15156d1-1769-4770-b33f-f0f3059fd74e None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:13.720488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:13.721158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:13.721443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:13.721719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:13.722394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:13.722700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:13.724073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:13.729783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 638/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:13.736274 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:13.768949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:13.854986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe388a-51b7-4b9e-a54c-394dc7256f34 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:13.902542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:13.902542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:13.902542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:13.904733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:13.904733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] RBAC: Adding query filter params (interface=public, service_id=5bf7f8c8454a4674a67ae74f54357f78, region_id=RegionOne) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:13.904733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:13.905306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09f19b-cf20-4978-a7cb-5d683d22d183 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:13.911376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 662/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Jul 26 10:16:13 2022] GET /identity/v3/endpoints?service_id=5bf7f8c8454a4674a67ae74f54357f78&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:16:13.917669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:14.002731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:14.021621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc84a5-b924-4544-89e1-186380563760 None admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:14.058619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b455c7-cef4-48e8-82c3-ea8040594033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:14.059247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b455c7-cef4-48e8-82c3-ea8040594033 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:14.059535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b455c7-cef4-48e8-82c3-ea8040594033 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:14.059804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b455c7-cef4-48e8-82c3-ea8040594033 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:14.060465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b455c7-cef4-48e8-82c3-ea8040594033 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:14.061884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b455c7-cef4-48e8-82c3-ea8040594033 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:14.069566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 639/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Jul 26 10:16:13 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:16:16.279396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fd97b-0809-4a5f-816c-c274ace717b1 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.279924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fd97b-0809-4a5f-816c-c274ace717b1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.279924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fd97b-0809-4a5f-816c-c274ace717b1 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.281404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 663/1302] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:16:16.286789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.287232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.287322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.307210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:16:16.308423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:16:16.383971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 640/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:16:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 10:16:16.407424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fd97b-0809-4a5f-816c-c274ace717b1 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.565534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:16.576773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fd97b-0809-4a5f-816c-c274ace717b1 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.634136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.635245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.635743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.636227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.637421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.640035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 10:16:16.654787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 10:16:16.655899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application with Lock( Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self._enter() Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application return self.creator() Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application created_value = creator( Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: ERROR keystone.server.flask.application Jul 26 10:16:16.656788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 664/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 10:16:16.664922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.747752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:16.772980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94380aff-4af6-42a2-a9d6-c0864507f1b8 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.808703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.809350 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.809628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:16.809898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] PATH_INFO: `/v3/services` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:16.810569 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:16:16.810867 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:16.812243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517ecd0-9bd3-49dd-9a60-7a9a0d837986 None admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:16.817957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 641/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Jul 26 10:16:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:16:16.827262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:16:16.955509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69afec-4f47-4955-b4c7-78bad3b51125 None admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:16:16.998985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec333e-a327-4735-9778-0c66c3fca380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:16:16.999625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec333e-a327-4735-9778-0c66c3fca380 None admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:16:16.999904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec333e-a327-4735-9778-0c66c3fca380 None admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:16:17.000177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec333e-a327-4735-9778-0c66c3fca380 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:16:17.000946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec333e-a327-4735-9778-0c66c3fca380 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:16:17.002369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec333e-a327-4735-9778-0c66c3fca380 None admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:16:17.026006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 665/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:16:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:16:26.814581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=30 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:16:27.020591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:23.830329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ebe5-db6e-4058-8578-e55879f8e3a5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:23.830875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ebe5-db6e-4058-8578-e55879f8e3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:23.830875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ebe5-db6e-4058-8578-e55879f8e3a5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:23.838202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9288c0c-2fae-4366-86d1-a111b195612c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:23.838715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9288c0c-2fae-4366-86d1-a111b195612c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:23.838814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9288c0c-2fae-4366-86d1-a111b195612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:23.843276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 642/1307] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:23.933135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d9288c0c-2fae-4366-86d1-a111b195612c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:23.934424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d9288c0c-2fae-4366-86d1-a111b195612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:24.064416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 666/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:24.116796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6d512-25ec-4cae-8724-96db2781396a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:24.117121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6d512-25ec-4cae-8724-96db2781396a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:24.117400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6d512-25ec-4cae-8724-96db2781396a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:24.119192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 643/1309] 10.222.0.18 () {54 vars in 965 bytes} [Tue Jul 26 10:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:24.127374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98193c-60af-4e73-825f-618974d57956 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:24.127555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98193c-60af-4e73-825f-618974d57956 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:24.127887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98193c-60af-4e73-825f-618974d57956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:24.213127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-7d98193c-60af-4e73-825f-618974d57956 None None] MFA Rules not processed for user `99a24c94f072452f8924a76f97ff2683`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:24.214352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7d98193c-60af-4e73-825f-618974d57956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:24.237200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:24.302973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 667/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 26 10:17:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:24.312787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6d512-25ec-4cae-8724-96db2781396a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:24.316418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fed6d512-25ec-4cae-8724-96db2781396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:24.501022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6d512-25ec-4cae-8724-96db2781396a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:24.591049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:24.591772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:24.592152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:24.592598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:24.594523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:24.653679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:24.721710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:24.723289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da36d1-3ecb-455a-8513-dc6765d35e65 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:24.744747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 644/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:17:27.076808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6963f-3e1b-4311-b051-c0d87ff8832e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:27.077955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6963f-3e1b-4311-b051-c0d87ff8832e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:27.077955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6963f-3e1b-4311-b051-c0d87ff8832e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:27.079123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 668/1312] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:27.085342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97743c-057f-40c6-ad17-d931e8111057 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:27.085342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97743c-057f-40c6-ad17-d931e8111057 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:27.085891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97743c-057f-40c6-ad17-d931e8111057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:27.174559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5d97743c-057f-40c6-ad17-d931e8111057 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:27.175831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5d97743c-057f-40c6-ad17-d931e8111057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:27.302752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 645/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:27.348811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6963f-3e1b-4311-b051-c0d87ff8832e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:27.351166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d2b6963f-3e1b-4311-b051-c0d87ff8832e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:27.471045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6963f-3e1b-4311-b051-c0d87ff8832e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:27.567013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:27.570495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:27.571268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:27.571623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:27.572286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:27.575186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:27.711181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:27.712651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e211a-80ec-4ba5-b7f3-5f5794ebd2c0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:27.732534 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 669/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:30.075068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd28e1-4d74-4ad4-bfde-1f4944010514 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:30.075618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd28e1-4d74-4ad4-bfde-1f4944010514 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:30.075618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd28e1-4d74-4ad4-bfde-1f4944010514 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:30.076979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 646/1315] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:30.082349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed732-d71b-4d99-9a6b-aee9f8e489ce None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:30.082801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed732-d71b-4d99-9a6b-aee9f8e489ce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:30.082920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ed732-d71b-4d99-9a6b-aee9f8e489ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:30.149062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5a3ed732-d71b-4d99-9a6b-aee9f8e489ce None None] MFA Rules not processed for user `ac5ae9b9caeb4dc28abf48c1aece3594`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:30.150305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5a3ed732-d71b-4d99-9a6b-aee9f8e489ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:30.202324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:30.250160 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 670/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:30.291120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd28e1-4d74-4ad4-bfde-1f4944010514 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:30.292693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a3dd28e1-4d74-4ad4-bfde-1f4944010514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:30.303600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:30.404954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd28e1-4d74-4ad4-bfde-1f4944010514 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:30.481928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:30.482705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:30.482984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:30.483258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:30.484891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:30.547642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:30.594686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:30.596127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65f27e-872d-46e8-bf75-231cee2b4ba8 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:30.614811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 647/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:33.242604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88db6-dc39-4fc0-b7a0-ed67d9c778b9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:33.243164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88db6-dc39-4fc0-b7a0-ed67d9c778b9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:33.243164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88db6-dc39-4fc0-b7a0-ed67d9c778b9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:33.244433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 671/1318] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:33.249750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5281e-68b2-40c6-9730-2970d7208b81 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:33.250164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5281e-68b2-40c6-9730-2970d7208b81 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:33.250312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5281e-68b2-40c6-9730-2970d7208b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:33.316960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-77c5281e-68b2-40c6-9730-2970d7208b81 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:33.318200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-77c5281e-68b2-40c6-9730-2970d7208b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:33.414481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 648/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:33.453267 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88db6-dc39-4fc0-b7a0-ed67d9c778b9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:33.454794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c7a88db6-dc39-4fc0-b7a0-ed67d9c778b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:33.556539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88db6-dc39-4fc0-b7a0-ed67d9c778b9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:33.629870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:33.631072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:33.631392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:33.631664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:33.633443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:33.640442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:33.743038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:33.744522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8509ce1-eb90-4749-82ab-7a905b04f489 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:33.763200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 672/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:36.485665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc233c-ce5d-4b14-a637-0dac0ade88f1 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:36.486211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc233c-ce5d-4b14-a637-0dac0ade88f1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:36.486303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc233c-ce5d-4b14-a637-0dac0ade88f1 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:36.487614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 649/1321] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:36.493086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334015dc-9b44-4048-9577-2e241aaf37e0 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:36.493565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334015dc-9b44-4048-9577-2e241aaf37e0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:36.493661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334015dc-9b44-4048-9577-2e241aaf37e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:36.560078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-334015dc-9b44-4048-9577-2e241aaf37e0 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:36.561331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-334015dc-9b44-4048-9577-2e241aaf37e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:36.618922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:36.659847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 673/1322] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:36.697380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc233c-ce5d-4b14-a637-0dac0ade88f1 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:36.699927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2ccc233c-ce5d-4b14-a637-0dac0ade88f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:36.723192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:36.820596 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc233c-ce5d-4b14-a637-0dac0ade88f1 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:36.902044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:36.902659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:36.902936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:36.903238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:36.904942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:36.980550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:37.022008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:37.023349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1c3ce-02a8-4a30-b867-36a27ed1eda3 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:37.043301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 650/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:17:39.115599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80ced-798b-4509-9206-8b0299964cea None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.116188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80ced-798b-4509-9206-8b0299964cea None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.116188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80ced-798b-4509-9206-8b0299964cea None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.117538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 674/1324] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:39.122814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488cd3-5b77-4bde-b521-ea4199d0a47b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.123221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488cd3-5b77-4bde-b521-ea4199d0a47b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.123485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488cd3-5b77-4bde-b521-ea4199d0a47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.189450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-16488cd3-5b77-4bde-b521-ea4199d0a47b None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:39.190542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-16488cd3-5b77-4bde-b521-ea4199d0a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:39.291312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 651/1325] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:39.326847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80ced-798b-4509-9206-8b0299964cea None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:39.328468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6ad80ced-798b-4509-9206-8b0299964cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:39.434311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80ced-798b-4509-9206-8b0299964cea None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:39.511190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:39.511784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:39.512003 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:39.512277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:39.513939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:39.531123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:39.632758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:39.634237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ad014-8287-4002-8609-b18858315791 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:39.653665 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 675/1326] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:41.726753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1338a3-487a-4e33-9834-1214335d529c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:41.727314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1338a3-487a-4e33-9834-1214335d529c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:41.727314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1338a3-487a-4e33-9834-1214335d529c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:41.728676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 652/1327] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:41.734941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e4df-26a6-49df-a551-9d51bd8a22e1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:41.735570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e4df-26a6-49df-a551-9d51bd8a22e1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:41.735570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e4df-26a6-49df-a551-9d51bd8a22e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:41.810447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-52a0e4df-26a6-49df-a551-9d51bd8a22e1 None None] MFA Rules not processed for user `ac5ae9b9caeb4dc28abf48c1aece3594`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:41.811660 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-52a0e4df-26a6-49df-a551-9d51bd8a22e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:41.876047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:41.909332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 676/1328] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:41.963085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9b39-ca6c-4eed-b264-c318d6f0a97d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:41.963391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9b39-ca6c-4eed-b264-c318d6f0a97d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:41.963632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9b39-ca6c-4eed-b264-c318d6f0a97d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:41.965054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 653/1329] 10.222.0.18 () {54 vars in 965 bytes} [Tue Jul 26 10:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:41.971304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ffc0-a3a5-43cd-9b6d-dee0c56f3d44 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:41.971593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ffc0-a3a5-43cd-9b6d-dee0c56f3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:41.971869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809ffc0-a3a5-43cd-9b6d-dee0c56f3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.054900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-b809ffc0-a3a5-43cd-9b6d-dee0c56f3d44 None None] MFA Rules not processed for user `99a24c94f072452f8924a76f97ff2683`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:42.056145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b809ffc0-a3a5-43cd-9b6d-dee0c56f3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:42.138691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 677/1330] 10.222.0.18 () {58 vars in 1062 bytes} [Tue Jul 26 10:17:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:42.147679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9b39-ca6c-4eed-b264-c318d6f0a97d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:42.149228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a7da9b39-ca6c-4eed-b264-c318d6f0a97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:42.181035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:42.254398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9b39-ca6c-4eed-b264-c318d6f0a97d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:42.330198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:42.330820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:42.331099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:42.331375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:42.333047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:42.414051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:42.447524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:42.449025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f35ff-fa0a-48f1-95aa-66e42439ed24 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:42.483771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 654/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:45.148525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9ee7-c26c-4396-a69a-c63ab0799429 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:45.149112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9ee7-c26c-4396-a69a-c63ab0799429 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:45.149112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e9ee7-c26c-4396-a69a-c63ab0799429 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:45.150540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 678/1332] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:45.155961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0dd25-4ae7-4237-9c90-3793dba3be4e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:45.156403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0dd25-4ae7-4237-9c90-3793dba3be4e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:45.156518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0dd25-4ae7-4237-9c90-3793dba3be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:45.224689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a5d0dd25-4ae7-4237-9c90-3793dba3be4e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:45.225908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a5d0dd25-4ae7-4237-9c90-3793dba3be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:45.322347 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 655/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:45.361908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9ee7-c26c-4396-a69a-c63ab0799429 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:45.363484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-590e9ee7-c26c-4396-a69a-c63ab0799429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:45.433266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:45.470219 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e9ee7-c26c-4396-a69a-c63ab0799429 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:45.542923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:45.543459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:45.543735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:45.544008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:45.545663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:45.654213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:45.655661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674279a-e677-439c-9da5-8e141b4f123c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:45.666054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:45.676408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 679/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:47.764409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496512ed-418b-4ed1-979a-17b4bdf20130 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:47.765029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496512ed-418b-4ed1-979a-17b4bdf20130 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:47.765029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496512ed-418b-4ed1-979a-17b4bdf20130 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:47.766395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 656/1335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:47.771481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6360-40a5-427c-a5c5-26090e174cce None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:47.771872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6360-40a5-427c-a5c5-26090e174cce None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:47.772030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef6360-40a5-427c-a5c5-26090e174cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:47.839704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d4ef6360-40a5-427c-a5c5-26090e174cce None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:47.840954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d4ef6360-40a5-427c-a5c5-26090e174cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:47.938061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 680/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:47.978310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496512ed-418b-4ed1-979a-17b4bdf20130 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:47.979833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-496512ed-418b-4ed1-979a-17b4bdf20130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:48.019970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:48.086779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496512ed-418b-4ed1-979a-17b4bdf20130 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:48.160417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:48.161077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:48.161344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:48.162251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:48.163869 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:48.246539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:48.272783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:48.274265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95f47e-771d-433e-86a1-de1ae033b6d3 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:48.292671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 657/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:50.709248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab027d-b582-4868-a200-66be12b0048e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:50.709882 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab027d-b582-4868-a200-66be12b0048e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:50.710083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab027d-b582-4868-a200-66be12b0048e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:50.711548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 681/1338] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:50.717513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747551ca-c178-4b5b-a9e1-22f79a5674fd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:50.717945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747551ca-c178-4b5b-a9e1-22f79a5674fd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:50.718064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747551ca-c178-4b5b-a9e1-22f79a5674fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:50.787482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-747551ca-c178-4b5b-a9e1-22f79a5674fd None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:50.788698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-747551ca-c178-4b5b-a9e1-22f79a5674fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:50.887728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 658/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:50.924096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab027d-b582-4868-a200-66be12b0048e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:50.925666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8aab027d-b582-4868-a200-66be12b0048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:51.001109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:51.030719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab027d-b582-4868-a200-66be12b0048e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:51.120761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:51.121415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:51.121696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:51.121970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:51.123598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:51.230592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:51.232263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a002c3-029a-4492-83c7-013294432e6a service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:51.258488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 682/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:55.416852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7b267-5ea0-4090-9134-a71a32e64de3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:55.417539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7b267-5ea0-4090-9134-a71a32e64de3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:55.417539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7b267-5ea0-4090-9134-a71a32e64de3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:55.418764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 659/1341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:55.424265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa548b8-e320-4cc3-9c97-001657b0ebb8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:55.424715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa548b8-e320-4cc3-9c97-001657b0ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:55.424890 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa548b8-e320-4cc3-9c97-001657b0ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:55.431192 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:55.497762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5aa548b8-e320-4cc3-9c97-001657b0ebb8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:55.498971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5aa548b8-e320-4cc3-9c97-001657b0ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:55.599202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 683/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:55.639024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7b267-5ea0-4090-9134-a71a32e64de3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:55.640539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-52b7b267-5ea0-4090-9134-a71a32e64de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:55.694135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:55.757766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7b267-5ea0-4090-9134-a71a32e64de3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:55.844710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:55.845398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:55.845681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:55.845970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:55.847558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:55.965783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:55.984455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:55.986048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b418293-df0f-416b-a7eb-d680b5fbf9c6 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:56.004368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 660/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:17:58.663445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5c5dd-b0d1-4a80-9e12-7391eaa43de5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:58.663938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5c5dd-b0d1-4a80-9e12-7391eaa43de5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:58.664049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5c5dd-b0d1-4a80-9e12-7391eaa43de5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:58.666310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 684/1344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:17:58.672080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b95f-0eef-4c92-82c9-088e01bec7a6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:58.672587 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b95f-0eef-4c92-82c9-088e01bec7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:58.672681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b95f-0eef-4c92-82c9-088e01bec7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:58.752218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c220b95f-0eef-4c92-82c9-088e01bec7a6 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:17:58.753541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c220b95f-0eef-4c92-82c9-088e01bec7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:58.865211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 661/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:17:58.903945 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5c5dd-b0d1-4a80-9e12-7391eaa43de5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:17:58.905650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f0d5c5dd-b0d1-4a80-9e12-7391eaa43de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:58.997566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:17:59.015286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5c5dd-b0d1-4a80-9e12-7391eaa43de5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:17:59.100637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:17:59.101289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:17:59.101571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:17:59.101892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:17:59.103458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:17:59.217973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:17:59.219313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71485a7-52e7-4f4f-88c3-6b1f76898027 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:17:59.241376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 685/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:17:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:03.293716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e3fc-b4b5-401e-a98a-43dcb1271cac None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:03.294276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e3fc-b4b5-401e-a98a-43dcb1271cac None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:03.294276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959e3fc-b4b5-401e-a98a-43dcb1271cac None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:03.295612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 662/1347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:03.300850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71a48d-ddfe-4394-9f50-a537f7fb2b94 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:03.301321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71a48d-ddfe-4394-9f50-a537f7fb2b94 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:03.301426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71a48d-ddfe-4394-9f50-a537f7fb2b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:03.318242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:03.371005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bf71a48d-ddfe-4394-9f50-a537f7fb2b94 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:03.372246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bf71a48d-ddfe-4394-9f50-a537f7fb2b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:03.474519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 686/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:03.514676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e3fc-b4b5-401e-a98a-43dcb1271cac None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:03.516232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7959e3fc-b4b5-401e-a98a-43dcb1271cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:03.592510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:03.657466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959e3fc-b4b5-401e-a98a-43dcb1271cac None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:03.749422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:03.750059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:03.750341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:03.750620 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:03.752432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:03.880208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:03.885380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:03.887087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f76c9e-8bee-4a6a-8bb7-1456ef888819 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:03.908288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 663/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:08.979793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716cd3-d007-4cb6-b1f8-df63fccdbec7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:08.980259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716cd3-d007-4cb6-b1f8-df63fccdbec7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:08.980356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf716cd3-d007-4cb6-b1f8-df63fccdbec7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:08.982297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 687/1350] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:08.987826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374fb5-080b-4403-a70d-302e6d6e7978 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:08.988647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374fb5-080b-4403-a70d-302e6d6e7978 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:08.988647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374fb5-080b-4403-a70d-302e6d6e7978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:09.178906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-35374fb5-080b-4403-a70d-302e6d6e7978 None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:09.181011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35374fb5-080b-4403-a70d-302e6d6e7978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:09.371900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 664/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:18:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:13.472145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=59 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:13.589578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a6e2-d0bf-465f-9e1c-7c779dc34b36 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:13.590313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a6e2-d0bf-465f-9e1c-7c779dc34b36 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:13.590792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a6e2-d0bf-465f-9e1c-7c779dc34b36 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:13.592640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 688/1352] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:13.597962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e01d7-8c35-45cf-b92b-90c280811f31 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:13.598947 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e01d7-8c35-45cf-b92b-90c280811f31 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:13.599434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e01d7-8c35-45cf-b92b-90c280811f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:13.662996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:13.687059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-138e01d7-8c35-45cf-b92b-90c280811f31 None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:13.688286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-138e01d7-8c35-45cf-b92b-90c280811f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:13.803979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 665/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:18:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:15.067280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70664a7-ae65-4947-bf75-7bda267d7b7b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:15.067807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70664a7-ae65-4947-bf75-7bda267d7b7b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:15.067939 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70664a7-ae65-4947-bf75-7bda267d7b7b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:15.069384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 689/1354] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:15.074847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05817ca-0422-4394-954f-dbc7dcdc8cdd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:15.075326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05817ca-0422-4394-954f-dbc7dcdc8cdd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:15.075592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05817ca-0422-4394-954f-dbc7dcdc8cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:15.167520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b05817ca-0422-4394-954f-dbc7dcdc8cdd None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:15.168756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b05817ca-0422-4394-954f-dbc7dcdc8cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:15.221832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:15.293119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 666/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:18:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:18.777159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a5db4-d8d4-4dfb-8ff7-71fbbe24acd4 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:18.778643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a5db4-d8d4-4dfb-8ff7-71fbbe24acd4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:18.778643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a5db4-d8d4-4dfb-8ff7-71fbbe24acd4 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:18.779456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 690/1356] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:18.786124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9382-a154-4f39-b23c-f2a6580e2a6c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:18.787988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9382-a154-4f39-b23c-f2a6580e2a6c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:18.788448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9382-a154-4f39-b23c-f2a6580e2a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:18.883765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9cae9382-a154-4f39-b23c-f2a6580e2a6c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:18.885458 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9cae9382-a154-4f39-b23c-f2a6580e2a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:19.000957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 667/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:19.056621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7aa7d-c16a-420f-ab6a-3d4dfa56eb24 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:19.057539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7aa7d-c16a-420f-ab6a-3d4dfa56eb24 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:19.058200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7aa7d-c16a-420f-ab6a-3d4dfa56eb24 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:19.060205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 691/1358] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 10:18:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:19.068785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902488fa-95f2-42e9-ab3d-ce43315f16df None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:19.069455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902488fa-95f2-42e9-ab3d-ce43315f16df None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:19.070122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902488fa-95f2-42e9-ab3d-ce43315f16df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:19.090925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:19.162528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-902488fa-95f2-42e9-ab3d-ce43315f16df None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:19.164243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-902488fa-95f2-42e9-ab3d-ce43315f16df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:19.303662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 668/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 10:18:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:19.311423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7aa7d-c16a-420f-ab6a-3d4dfa56eb24 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:19.313234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-62c7aa7d-c16a-420f-ab6a-3d4dfa56eb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:19.471906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7aa7d-c16a-420f-ab6a-3d4dfa56eb24 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:19.548874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:19.594669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:19.595294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:19.595571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:19.595841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:19.597468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:19.696549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:19.698191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e642196f-3c67-4d05-a3e1-e78fc944f533 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:19.719022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 692/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:21.989692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b49975-400f-499f-a04d-e6345c2d64d3 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:21.990280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b49975-400f-499f-a04d-e6345c2d64d3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:21.990280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b49975-400f-499f-a04d-e6345c2d64d3 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:21.991803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 669/1361] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:21.997253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe2e8-06dd-4f44-a5f3-77084ee871e6 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:21.997761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe2e8-06dd-4f44-a5f3-77084ee871e6 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:21.997852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fe2e8-06dd-4f44-a5f3-77084ee871e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:22.074777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a77fe2e8-06dd-4f44-a5f3-77084ee871e6 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:22.076051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a77fe2e8-06dd-4f44-a5f3-77084ee871e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:22.115540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:22.181828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 693/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:22.236052 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b49975-400f-499f-a04d-e6345c2d64d3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:22.237764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-66b49975-400f-499f-a04d-e6345c2d64d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:22.330314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:22.424850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b49975-400f-499f-a04d-e6345c2d64d3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:22.588671 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:22.589334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:22.589614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:22.589891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:22.591798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:22.619897 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:22.699652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:22.701476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51177e0-c4eb-474f-83a7-22e5b3147722 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:22.725016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 670/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:25.146553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc40f4-7bd0-4a1d-aa9b-96e0ef95de2d None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:25.147080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc40f4-7bd0-4a1d-aa9b-96e0ef95de2d None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:25.147173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc40f4-7bd0-4a1d-aa9b-96e0ef95de2d None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:25.148545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 694/1364] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:25.154223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9dc4-a5c4-4e99-b31d-9354df274d14 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:25.154684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9dc4-a5c4-4e99-b31d-9354df274d14 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:25.154768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f9dc4-a5c4-4e99-b31d-9354df274d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:25.240555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ef2f9dc4-a5c4-4e99-b31d-9354df274d14 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:25.242019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ef2f9dc4-a5c4-4e99-b31d-9354df274d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:25.349502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:25.357471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 671/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:25.398549 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804350ef-d59f-4f20-a577-cf334d2e4833 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:25.398833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804350ef-d59f-4f20-a577-cf334d2e4833 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:25.399112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804350ef-d59f-4f20-a577-cf334d2e4833 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:25.400688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 695/1366] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 10:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:25.406509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da4d19-c80a-4de9-85c1-ee9178b078fa None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:25.406963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da4d19-c80a-4de9-85c1-ee9178b078fa None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:25.407245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da4d19-c80a-4de9-85c1-ee9178b078fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:25.491555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-04da4d19-c80a-4de9-85c1-ee9178b078fa None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:25.492866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-04da4d19-c80a-4de9-85c1-ee9178b078fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:25.640465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 672/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 10:18:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:25.648296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804350ef-d59f-4f20-a577-cf334d2e4833 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:25.649884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-804350ef-d59f-4f20-a577-cf334d2e4833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:25.849366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804350ef-d59f-4f20-a577-cf334d2e4833 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:25.871482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:25.984138 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:25.985263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:25.985700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:25.986137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:25.987809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:26.099692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:26.101506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13233f40-a2b6-4565-a6c8-4caab0015250 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:26.133329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 696/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:27.084533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3d56-f420-4f4a-9ce9-f76403c5c118 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:27.085114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3d56-f420-4f4a-9ce9-f76403c5c118 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:27.085454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3d56-f420-4f4a-9ce9-f76403c5c118 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:27.087328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 673/1369] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:18:27.092787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8715e-7ced-4b88-aff7-02850c39956a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:27.093368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8715e-7ced-4b88-aff7-02850c39956a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:27.093368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a8715e-7ced-4b88-aff7-02850c39956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:27.131933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:27.174362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-08a8715e-7ced-4b88-aff7-02850c39956a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:27.175642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-08a8715e-7ced-4b88-aff7-02850c39956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:27.320899 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 697/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:27.680249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8642-f0db-4b7b-87fb-b915c54f8cfe None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:27.680249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8642-f0db-4b7b-87fb-b915c54f8cfe None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:27.680249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa8642-f0db-4b7b-87fb-b915c54f8cfe None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:27.680249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 674/1371] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jul 26 10:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:27.693456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e23b-e1b0-4dfe-b75c-5cb78a8728ec None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:27.693456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e23b-e1b0-4dfe-b75c-5cb78a8728ec None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:27.693456 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e23b-e1b0-4dfe-b75c-5cb78a8728ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:27.795449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cf01e23b-e1b0-4dfe-b75c-5cb78a8728ec None None] MFA Rules not processed for user `0c3969e48a534d8babef2991941c01bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:27.797405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cf01e23b-e1b0-4dfe-b75c-5cb78a8728ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:27.875810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:27.912225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 698/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jul 26 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:18:27.919791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8642-f0db-4b7b-87fb-b915c54f8cfe None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:27.921346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-92fa8642-f0db-4b7b-87fb-b915c54f8cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:27.984095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:28.056805 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa8642-f0db-4b7b-87fb-b915c54f8cfe None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:28.145734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3969e48a534d8babef2991941c01bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:28.146381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:28.146637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:28.146914 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:28.148627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:28.276978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:28.297691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:28.299169 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9e000-518e-451f-9dbe-18aec3f1b0cd service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:28.337576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 675/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:28.444955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac112-772c-4803-b63a-d032f04a5fda None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:28.446634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac112-772c-4803-b63a-d032f04a5fda None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:28.446634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bac112-772c-4803-b63a-d032f04a5fda None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:28.450963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 699/1374] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:28.452718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892c15-76ac-4269-8132-30c6636b1f64 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:28.452718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892c15-76ac-4269-8132-30c6636b1f64 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:28.452718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee892c15-76ac-4269-8132-30c6636b1f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:28.543262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ee892c15-76ac-4269-8132-30c6636b1f64 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:28.545210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ee892c15-76ac-4269-8132-30c6636b1f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:28.686588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 676/1375] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:28.732737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac112-772c-4803-b63a-d032f04a5fda None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:28.734556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-93bac112-772c-4803-b63a-d032f04a5fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:28.927683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bac112-772c-4803-b63a-d032f04a5fda None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:28.987119 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:29.067484 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:29.068127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:29.068404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:29.068679 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:29.070453 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:29.197750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:29.200226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c4df9-0c84-4fd8-a1f5-5786812334b9 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:29.232424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 700/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:31.323632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a7dad-19c2-4ac1-9076-156db001caad None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:31.324178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a7dad-19c2-4ac1-9076-156db001caad None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:31.324178 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a7dad-19c2-4ac1-9076-156db001caad None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:31.325566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 677/1377] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:31.331059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf228-c2ad-4dfd-b473-e1110081f1ba None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:31.331517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf228-c2ad-4dfd-b473-e1110081f1ba None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:31.331740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbf228-c2ad-4dfd-b473-e1110081f1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:31.402492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-cbdbf228-c2ad-4dfd-b473-e1110081f1ba None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:31.403728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cbdbf228-c2ad-4dfd-b473-e1110081f1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:31.412784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:31.526803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 701/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:18:31.570295 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a7dad-19c2-4ac1-9076-156db001caad None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:31.571787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6c1a7dad-19c2-4ac1-9076-156db001caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:31.635124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:31.735556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a7dad-19c2-4ac1-9076-156db001caad None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:31.894632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:31.896013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:31.896324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:31.896594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:31.898248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:31.918601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:32.052273 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:32.054180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219bd84-bec4-48e4-b24d-39a35f3e78a5 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:32.075059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 678/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:34.183779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0026-8d64-48a9-8b25-b19d1d01a612 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.184315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0026-8d64-48a9-8b25-b19d1d01a612 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.184315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c0026-8d64-48a9-8b25-b19d1d01a612 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.185921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 702/1380] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:34.191041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ebd1-8bc7-4d4e-8ba0-446ef47571a9 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.191496 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ebd1-8bc7-4d4e-8ba0-446ef47571a9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.191593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146ebd1-8bc7-4d4e-8ba0-446ef47571a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.269268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b146ebd1-8bc7-4d4e-8ba0-446ef47571a9 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:34.271260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b146ebd1-8bc7-4d4e-8ba0-446ef47571a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:34.381301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 679/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:34.384755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:34.424733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0026-8d64-48a9-8b25-b19d1d01a612 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:34.426442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-540c0026-8d64-48a9-8b25-b19d1d01a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:34.579455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:34.591420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c0026-8d64-48a9-8b25-b19d1d01a612 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:34.716464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:34.717286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:34.717666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:34.718043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:34.719755 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:34.822167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:34.823913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd7a5e-388b-4fe7-914a-a77bfc65d93c service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:34.835290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:34.845718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 703/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:36.932738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9791f1-db69-4bc5-ab08-b72fb5ab5741 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:36.933450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9791f1-db69-4bc5-ab08-b72fb5ab5741 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:36.933450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9791f1-db69-4bc5-ab08-b72fb5ab5741 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:36.934677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 680/1383] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:36.940127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e5bd-66b8-4d3c-9a04-7f3a75213dc8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:36.940577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e5bd-66b8-4d3c-9a04-7f3a75213dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:36.940691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e5bd-66b8-4d3c-9a04-7f3a75213dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:37.028324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d5a6e5bd-66b8-4d3c-9a04-7f3a75213dc8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:37.029957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d5a6e5bd-66b8-4d3c-9a04-7f3a75213dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:37.134283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 704/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:37.176341 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9791f1-db69-4bc5-ab08-b72fb5ab5741 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:37.178071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4d9791f1-db69-4bc5-ab08-b72fb5ab5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:37.363307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9791f1-db69-4bc5-ab08-b72fb5ab5741 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:37.455403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:37.507297 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:37.507984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:37.508332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:37.508668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:37.510320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:37.627768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:37.630888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd5948-fc78-4fdb-8952-41e8895b849e service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:37.653479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 681/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:39.660087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ce5e-163f-485c-80fd-d6284a433b84 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:39.661218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ce5e-163f-485c-80fd-d6284a433b84 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:39.661342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041ce5e-163f-485c-80fd-d6284a433b84 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:39.662691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 705/1386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:39.669638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75de0-e5d7-426c-90f4-5a76d012b442 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:39.670106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75de0-e5d7-426c-90f4-5a76d012b442 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:39.670357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee75de0-e5d7-426c-90f4-5a76d012b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:39.763402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7ee75de0-e5d7-426c-90f4-5a76d012b442 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:39.765172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7ee75de0-e5d7-426c-90f4-5a76d012b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:39.807771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:39.908443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 682/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:39.965618 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ce5e-163f-485c-80fd-d6284a433b84 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:39.967750 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-2041ce5e-163f-485c-80fd-d6284a433b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:40.056595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:40.135896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041ce5e-163f-485c-80fd-d6284a433b84 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:40.265999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:40.266545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:40.266879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:40.267102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:40.268711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:40.308181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:40.365235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:40.366880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c576c-9f48-4cb2-9992-b1a7e7431be6 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:40.386413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 706/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:18:42.516482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e306e7a-a487-48d8-bf5a-e4796f4c0edd None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:42.517191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e306e7a-a487-48d8-bf5a-e4796f4c0edd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:42.517191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e306e7a-a487-48d8-bf5a-e4796f4c0edd None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:42.518479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 683/1389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:42.523942 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1e83-a2b7-49ff-b752-08cbe3d94a94 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:42.524405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1e83-a2b7-49ff-b752-08cbe3d94a94 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:42.524510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb1e83-a2b7-49ff-b752-08cbe3d94a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:42.590732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4ccb1e83-a2b7-49ff-b752-08cbe3d94a94 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:42.591932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4ccb1e83-a2b7-49ff-b752-08cbe3d94a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:42.704958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 707/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:42.749965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e306e7a-a487-48d8-bf5a-e4796f4c0edd None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:42.751564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7e306e7a-a487-48d8-bf5a-e4796f4c0edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:42.905425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e306e7a-a487-48d8-bf5a-e4796f4c0edd None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:42.922627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:43.019482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:43.020593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:43.020903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:43.021172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:43.022776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:43.115657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:43.117286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc8b06-c0d6-43d6-bd05-3436c22657fe service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:43.137211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 684/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:43.714626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b31-71eb-4b30-96e9-22bfb2368a19 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:43.715182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b31-71eb-4b30-96e9-22bfb2368a19 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:43.715182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9b31-71eb-4b30-96e9-22bfb2368a19 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:43.716581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 708/1392] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:43.721995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219746-4690-4dab-9eaa-8dae9b6fe030 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:43.722407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219746-4690-4dab-9eaa-8dae9b6fe030 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:43.722546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b219746-4690-4dab-9eaa-8dae9b6fe030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:43.749638 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:43.792136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2b219746-4690-4dab-9eaa-8dae9b6fe030 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:43.793392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2b219746-4690-4dab-9eaa-8dae9b6fe030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:43.892157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 685/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:43.952615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9622d6-07cb-4a8f-ae36-7a3cf4b64d86 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:43.952941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9622d6-07cb-4a8f-ae36-7a3cf4b64d86 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:43.953220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9622d6-07cb-4a8f-ae36-7a3cf4b64d86 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:43.954606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 709/1394] 10.222.0.18 () {54 vars in 966 bytes} [Tue Jul 26 10:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:43.959993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8ef3-e692-413a-be01-0bd440f1c84b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:43.960446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8ef3-e692-413a-be01-0bd440f1c84b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:43.960885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a8ef3-e692-413a-be01-0bd440f1c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:44.043077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6a5a8ef3-e692-413a-be01-0bd440f1c84b None None] MFA Rules not processed for user `82bfade65449437b928932715d5e8a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:44.044279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6a5a8ef3-e692-413a-be01-0bd440f1c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:44.083921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:44.120364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 686/1395] 10.222.0.18 () {58 vars in 1063 bytes} [Tue Jul 26 10:18:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:44.127832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9622d6-07cb-4a8f-ae36-7a3cf4b64d86 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:44.129492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0c9622d6-07cb-4a8f-ae36-7a3cf4b64d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:44.142873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:44.231060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9622d6-07cb-4a8f-ae36-7a3cf4b64d86 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:44.311110 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82bfade65449437b928932715d5e8a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:44.311734 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:44.312015 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:44.312289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:44.313923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:44.383253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:44.425558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:44.426907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c32399-2da2-419e-bafe-7440f39e382c service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:44.444604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 710/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:45.191150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd59d-0561-47b2-af2c-16e6d33c8ab3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.192315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd59d-0561-47b2-af2c-16e6d33c8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.192315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cd59d-0561-47b2-af2c-16e6d33c8ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.225845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a00e-c590-400f-b48b-a81d08236c6b None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.225845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a00e-c590-400f-b48b-a81d08236c6b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.225845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2a00e-c590-400f-b48b-a81d08236c6b None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.225845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 711/1397] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:18:45.237748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6c229-7886-4c06-a904-4e3f92799cd9 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.238088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6c229-7886-4c06-a904-4e3f92799cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.238366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6c229-7886-4c06-a904-4e3f92799cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.274763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d43cd59d-0561-47b2-af2c-16e6d33c8ab3 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:45.275998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d43cd59d-0561-47b2-af2c-16e6d33c8ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.312962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-39e6c229-7886-4c06-a904-4e3f92799cd9 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:45.314189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-39e6c229-7886-4c06-a904-4e3f92799cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.368976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 687/1398] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:45.418154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc12ab-fefb-442a-9483-6fd6f69a3dbb None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.418539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 712/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:18:45.418678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc12ab-fefb-442a-9483-6fd6f69a3dbb None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.419207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc12ab-fefb-442a-9483-6fd6f69a3dbb None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.421077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 688/1400] 10.222.0.18 () {54 vars in 943 bytes} [Tue Jul 26 10:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:18:45.428709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.429029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.429398 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.457186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:45.464033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc12ab-fefb-442a-9483-6fd6f69a3dbb None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:45.465449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f3cc12ab-fefb-442a-9483-6fd6f69a3dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.511509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] MFA Rules not processed for user `7005963bb5b241c2b24a3fe6eab876dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:45.512959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.528802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:45.618789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc12ab-fefb-442a-9483-6fd6f69a3dbb None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:45.623957 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 713/1401] 10.222.0.18 () {58 vars in 1040 bytes} [Tue Jul 26 10:18:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:45.634363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:45.644776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e82142-ebe9-47cd-819c-800c3c27379e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:45.717922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:45.737135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:45.737762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.738039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.738312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.740518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.755058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:45.755682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:45.755958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:45.756228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:45.757904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:45.759402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:45.832101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:45.834277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a827f3-bb0e-45bf-bbd9-f93463232add service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:45.844331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:45.845978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb618114-0fad-48b7-bc58-b725e6ce716e service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:45.852860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 689/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:18:45.855114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 714/1403] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:18:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:18:47.951878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33cf6-2839-4f96-8101-c20e3ad5bc9c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:47.953884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33cf6-2839-4f96-8101-c20e3ad5bc9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:47.954158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe33cf6-2839-4f96-8101-c20e3ad5bc9c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:47.955567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 690/1404] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:18:47.962199 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840c75-7e86-4a5f-a26c-becf2d1cdd34 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:47.963123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840c75-7e86-4a5f-a26c-becf2d1cdd34 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:47.963414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0840c75-7e86-4a5f-a26c-becf2d1cdd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:48.036206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d0840c75-7e86-4a5f-a26c-becf2d1cdd34 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:48.037459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d0840c75-7e86-4a5f-a26c-becf2d1cdd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:48.101659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:48.156905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 715/1405] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:48.199591 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe33cf6-2839-4f96-8101-c20e3ad5bc9c None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:48.201444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ebe33cf6-2839-4f96-8101-c20e3ad5bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:48.369166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:48.371967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe33cf6-2839-4f96-8101-c20e3ad5bc9c None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:48.511165 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:48.511787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:48.512064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:48.512333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:48.514152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:48.622992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:48.624555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883b08e-4016-4e1c-8e66-007fdedd3e98 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:48.651426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 691/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:18:50.695474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26995338-e32e-435b-ad0b-68e47ac461c5 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:50.697642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26995338-e32e-435b-ad0b-68e47ac461c5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:50.698431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26995338-e32e-435b-ad0b-68e47ac461c5 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:50.700446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 716/1407] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:18:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:18:50.705984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f828d16-8bcd-4538-b5dd-d155dccc24f7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:50.706489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f828d16-8bcd-4538-b5dd-d155dccc24f7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:50.706600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f828d16-8bcd-4538-b5dd-d155dccc24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:50.711404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:50.786601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9f828d16-8bcd-4538-b5dd-d155dccc24f7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:18:50.787916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9f828d16-8bcd-4538-b5dd-d155dccc24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:50.899925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 692/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:18:50.948547 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26995338-e32e-435b-ad0b-68e47ac461c5 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:18:50.949163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-26995338-e32e-435b-ad0b-68e47ac461c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:51.167333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26995338-e32e-435b-ad0b-68e47ac461c5 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:18:51.214513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:18:51.295627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:18:51.296375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:18:51.296723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:18:51.297111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:18:51.298981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:18:51.395895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:18:51.397556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc15d1-9b4b-49da-8e97-ed04c806d858 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:18:51.416460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 717/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:00.898257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=64 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:01.414091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=79 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:07.995064 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653c19-58d2-4c5b-b516-a9f06a1d2e73 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:07.995634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653c19-58d2-4c5b-b516-a9f06a1d2e73 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:07.995634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653c19-58d2-4c5b-b516-a9f06a1d2e73 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:07.997141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 693/1410] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jul 26 10:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:08.002083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fef6-e0d9-4c37-a971-724b2ccbf006 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:08.002522 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fef6-e0d9-4c37-a971-724b2ccbf006 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:08.002674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fef6-e0d9-4c37-a971-724b2ccbf006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:08.079546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8aa1fef6-e0d9-4c37-a971-724b2ccbf006 None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:08.080785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8aa1fef6-e0d9-4c37-a971-724b2ccbf006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:08.200309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 718/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 26 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:08.215107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a858-5a77-4da7-9e31-74ce978501f2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:08.215391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a858-5a77-4da7-9e31-74ce978501f2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:08.215691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32a858-5a77-4da7-9e31-74ce978501f2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:08.217130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 694/1412] 10.222.0.18 () {54 vars in 918 bytes} [Tue Jul 26 10:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:08.221891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5e15-c19b-4018-99e1-4bb20d447a08 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:08.222177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5e15-c19b-4018-99e1-4bb20d447a08 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:08.222450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5e15-c19b-4018-99e1-4bb20d447a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:08.295287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:08.298414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-49df5e15-c19b-4018-99e1-4bb20d447a08 None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:08.300228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-49df5e15-c19b-4018-99e1-4bb20d447a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:08.413986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 719/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 26 10:19:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:10.909612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4656d80-6519-4d64-a23d-1e989f82025f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:10.910193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4656d80-6519-4d64-a23d-1e989f82025f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:10.910193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4656d80-6519-4d64-a23d-1e989f82025f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:10.911530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 695/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:10.916856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0f50c-e4fb-4b3d-9872-55cdfea26dde None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:10.917301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0f50c-e4fb-4b3d-9872-55cdfea26dde None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:10.917436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0f50c-e4fb-4b3d-9872-55cdfea26dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:10.985010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e1a0f50c-e4fb-4b3d-9872-55cdfea26dde None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:10.986236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e1a0f50c-e4fb-4b3d-9872-55cdfea26dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:11.042928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:11.087055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 720/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:11.129488 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4656d80-6519-4d64-a23d-1e989f82025f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:11.130998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b4656d80-6519-4d64-a23d-1e989f82025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:11.276176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4656d80-6519-4d64-a23d-1e989f82025f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:11.353531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:11.400241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:11.400891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:11.401170 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:11.401440 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:11.403124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:11.496043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:11.497698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118bf87-4aee-4714-b62f-539f6bef891f service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:11.516614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 696/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:12.422713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fba19-f8d9-4a31-89b3-feeec30d96b2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:12.423318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fba19-f8d9-4a31-89b3-feeec30d96b2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:12.423318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fba19-f8d9-4a31-89b3-feeec30d96b2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:12.424607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 721/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:12.430017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25ce19-14e5-41f7-b1f8-68bb6326705f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:12.430485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25ce19-14e5-41f7-b1f8-68bb6326705f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:12.430598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25ce19-14e5-41f7-b1f8-68bb6326705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:12.510577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-df25ce19-14e5-41f7-b1f8-68bb6326705f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:12.511812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-df25ce19-14e5-41f7-b1f8-68bb6326705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:12.539584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:12.609539 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 697/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:12.766246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fba19-f8d9-4a31-89b3-feeec30d96b2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:12.767691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f94fba19-f8d9-4a31-89b3-feeec30d96b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:12.916173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fba19-f8d9-4a31-89b3-feeec30d96b2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:12.962831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:13.040553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:13.041117 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:13.041396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:13.041666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:13.043285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:13.136314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:13.138109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1a876-27c2-42fe-8e71-d3c5a793e449 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:13.156306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 722/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:14.052333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332b48c-d18c-4dd1-ae11-c1137087d5d4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:14.052891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332b48c-d18c-4dd1-ae11-c1137087d5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:14.052891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332b48c-d18c-4dd1-ae11-c1137087d5d4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:14.054312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 698/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:14.059247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f7f8-50f7-46a2-8061-08e6bfa89c34 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:14.059681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f7f8-50f7-46a2-8061-08e6bfa89c34 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:14.059786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f7f8-50f7-46a2-8061-08e6bfa89c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:14.113951 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:14.137107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-fac3f7f8-50f7-46a2-8061-08e6bfa89c34 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:14.138339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-fac3f7f8-50f7-46a2-8061-08e6bfa89c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:14.235500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 723/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:14.386259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332b48c-d18c-4dd1-ae11-c1137087d5d4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:14.387765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0332b48c-d18c-4dd1-ae11-c1137087d5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:14.530504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332b48c-d18c-4dd1-ae11-c1137087d5d4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:14.542354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:14.647470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:14.648090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:14.648372 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:14.648644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:14.650301 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:14.741471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:14.743087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21b4ee-c2ba-4a0d-833b-6995f2cb43ce service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:14.761658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 699/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:15.631617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698760-fcd3-4167-a79d-7493e7a26979 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:15.632196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698760-fcd3-4167-a79d-7493e7a26979 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:15.632196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c698760-fcd3-4167-a79d-7493e7a26979 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:15.633559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 724/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:15.638362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050993a-6d2c-4272-8d04-01a1df7c0104 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:15.638759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050993a-6d2c-4272-8d04-01a1df7c0104 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:15.638900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050993a-6d2c-4272-8d04-01a1df7c0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:15.659389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:15.716597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d050993a-6d2c-4272-8d04-01a1df7c0104 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:15.717851 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d050993a-6d2c-4272-8d04-01a1df7c0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:15.812999 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 700/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:15.962476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698760-fcd3-4167-a79d-7493e7a26979 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:15.964062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0c698760-fcd3-4167-a79d-7493e7a26979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:16.078454 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:16.115584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c698760-fcd3-4167-a79d-7493e7a26979 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:16.228814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:16.229390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:16.229670 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:16.229944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:16.231576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:16.308447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:16.322559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:16.324209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622b2a7-5a32-46ca-bddc-1e4bd2f6a34a service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:16.342038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 725/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:17.219154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401931-23f2-4f08-a6ef-df95ccc9419b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.219694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401931-23f2-4f08-a6ef-df95ccc9419b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.219694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12401931-23f2-4f08-a6ef-df95ccc9419b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.220997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 701/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:19:17.226265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f8cc-5878-4459-8b31-789987cad207 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.226702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f8cc-5878-4459-8b31-789987cad207 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.226830 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081f8cc-5878-4459-8b31-789987cad207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.303720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d081f8cc-5878-4459-8b31-789987cad207 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:17.304993 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d081f8cc-5878-4459-8b31-789987cad207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:17.402711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 726/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:19:17.557251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401931-23f2-4f08-a6ef-df95ccc9419b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:17.558917 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-12401931-23f2-4f08-a6ef-df95ccc9419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:17.645756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:17.707794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12401931-23f2-4f08-a6ef-df95ccc9419b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:17.821709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:17.822850 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:17.823128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:17.823403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:17.825134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:17.873153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:17.914974 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:17.916912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2985f4-8edb-411c-9af1-2e3531142547 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:17.935370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 702/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:18.742711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369725-dcf7-49d6-88eb-503c0a2d3891 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:18.743286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369725-dcf7-49d6-88eb-503c0a2d3891 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:18.743286 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369725-dcf7-49d6-88eb-503c0a2d3891 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:18.744604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 727/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:18.749728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccc618-2bb6-42fc-b8f9-e647c65904d4 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:18.750141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccc618-2bb6-42fc-b8f9-e647c65904d4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:18.750269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccc618-2bb6-42fc-b8f9-e647c65904d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:18.831135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2dccc618-2bb6-42fc-b8f9-e647c65904d4 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:18.832892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2dccc618-2bb6-42fc-b8f9-e647c65904d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:18.930721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 703/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:19.082931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6369725-dcf7-49d6-88eb-503c0a2d3891 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:19.084459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e6369725-dcf7-49d6-88eb-503c0a2d3891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:19.135190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:19.232296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6369725-dcf7-49d6-88eb-503c0a2d3891 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:19.344789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:19.345369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:19.345652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:19.345925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:19.347572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:19.354521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:19.436558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:19.438280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7d4ca-dd8f-4c0f-a59e-b15bfe8de52c service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:19.457614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 728/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:20.286883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c00b8-132c-4dc8-bd22-669d803e1bb0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:20.287421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c00b8-132c-4dc8-bd22-669d803e1bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:20.287421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c00b8-132c-4dc8-bd22-669d803e1bb0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:20.288765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 704/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:20.293793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4216-1796-41c3-bd6a-59ade23c6ea5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:20.294218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4216-1796-41c3-bd6a-59ade23c6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:20.294339 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b4216-1796-41c3-bd6a-59ade23c6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:20.371225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ed9b4216-1796-41c3-bd6a-59ade23c6ea5 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:20.372464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed9b4216-1796-41c3-bd6a-59ade23c6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:20.440732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:20.472206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 729/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:20.622261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c00b8-132c-4dc8-bd22-669d803e1bb0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:20.623900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ca8c00b8-132c-4dc8-bd22-669d803e1bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:20.642370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:20.783352 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c00b8-132c-4dc8-bd22-669d803e1bb0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:20.874394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:20.900068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:20.900690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:20.901008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:20.901279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:20.902908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:20.993711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:20.995326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba587e4-20fd-4a47-870b-826951791369 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:21.022550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 705/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:21.826258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b461a6-24ef-4770-826a-511feb7ca1e8 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:21.826797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b461a6-24ef-4770-826a-511feb7ca1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:21.826797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b461a6-24ef-4770-826a-511feb7ca1e8 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:21.828159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 730/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:21.833504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20e74-0660-4d89-ad60-e2aaec15a9f6 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:21.833990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20e74-0660-4d89-ad60-e2aaec15a9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:21.834114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f20e74-0660-4d89-ad60-e2aaec15a9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:21.913019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-e1f20e74-0660-4d89-ad60-e2aaec15a9f6 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:21.914294 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-e1f20e74-0660-4d89-ad60-e2aaec15a9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:21.958495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:22.015769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 706/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:22.168179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b461a6-24ef-4770-826a-511feb7ca1e8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:22.169686 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-21b461a6-24ef-4770-826a-511feb7ca1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:22.317414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b461a6-24ef-4770-826a-511feb7ca1e8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:22.370958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:22.431789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:22.432313 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:22.432607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:22.432886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:22.434512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:22.524403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:22.526029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf4348-dc08-46e4-a19b-d7420898e446 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:22.543949 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 731/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:23.365500 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe591-2212-45ee-8ce1-1945664a7ca2 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:23.366056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe591-2212-45ee-8ce1-1945664a7ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:23.366056 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fe591-2212-45ee-8ce1-1945664a7ca2 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:23.367418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 707/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:23.372413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded827e0-75a9-4f66-9423-be4479d1eff7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:23.372887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded827e0-75a9-4f66-9423-be4479d1eff7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:23.372988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded827e0-75a9-4f66-9423-be4479d1eff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:23.446626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ded827e0-75a9-4f66-9423-be4479d1eff7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:23.447836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ded827e0-75a9-4f66-9423-be4479d1eff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:23.449903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:23.552507 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 732/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:23.707328 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fe591-2212-45ee-8ce1-1945664a7ca2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:23.708863 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ca0fe591-2212-45ee-8ce1-1945664a7ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:23.856411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fe591-2212-45ee-8ce1-1945664a7ca2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:23.886782 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:23.979983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:23.980599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:23.980910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:23.981186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:23.982816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:24.193442 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:24.195049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e90c4-270b-4a23-920f-391f11b41aa4 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:24.213574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 708/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:26.132492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8a8a3-0bba-46a5-9386-3c419b725431 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:26.133089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8a8a3-0bba-46a5-9386-3c419b725431 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:26.133089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8a8a3-0bba-46a5-9386-3c419b725431 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:26.134452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 733/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:26.139875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd645-1bfd-4bf2-8fd5-8086977d54a7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:26.140307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd645-1bfd-4bf2-8fd5-8086977d54a7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:26.140414 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdd645-1bfd-4bf2-8fd5-8086977d54a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:26.181127 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:26.207197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-1bcdd645-1bfd-4bf2-8fd5-8086977d54a7 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:26.208354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-1bcdd645-1bfd-4bf2-8fd5-8086977d54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:26.303427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 709/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:26.342510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8a8a3-0bba-46a5-9386-3c419b725431 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:26.344046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-46f8a8a3-0bba-46a5-9386-3c419b725431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:26.448342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8a8a3-0bba-46a5-9386-3c419b725431 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:26.480048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:26.523864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:26.524493 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:26.524777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:26.525085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:26.526719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:26.634928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:26.636360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d08b3-9b6c-4d68-9396-cf655537e090 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:26.653932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 734/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:28.823368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e3953-2bdf-43cb-9bb1-961f636996a9 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:28.824030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e3953-2bdf-43cb-9bb1-961f636996a9 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:28.824030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e3953-2bdf-43cb-9bb1-961f636996a9 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:28.825362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 710/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:28.830879 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab990-388b-464b-b049-aec7f1b21d44 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:28.831344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab990-388b-464b-b049-aec7f1b21d44 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:28.831474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bab990-388b-464b-b049-aec7f1b21d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:28.898622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-e9bab990-388b-464b-b049-aec7f1b21d44 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:28.899834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e9bab990-388b-464b-b049-aec7f1b21d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:28.912940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:28.998343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 735/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:29.036186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e3953-2bdf-43cb-9bb1-961f636996a9 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:29.037731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c68e3953-2bdf-43cb-9bb1-961f636996a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:29.141495 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e3953-2bdf-43cb-9bb1-961f636996a9 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:29.157324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:29.217973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:29.218586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:29.218862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:29.219133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:29.220732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:29.335081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:29.336510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76edb56-955a-43de-973c-05bf2bc32a7c service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:29.356629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 711/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:31.695062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a644c-ff1c-4960-9c2e-b23f6816a69a None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:31.695616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a644c-ff1c-4960-9c2e-b23f6816a69a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:31.695616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a644c-ff1c-4960-9c2e-b23f6816a69a None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:31.697214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 736/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:31.702691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc1e6-0fe9-4bb5-98a2-7f4752f52c31 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:31.703144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc1e6-0fe9-4bb5-98a2-7f4752f52c31 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:31.703262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc1e6-0fe9-4bb5-98a2-7f4752f52c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:31.750403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:31.769007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-41bfc1e6-0fe9-4bb5-98a2-7f4752f52c31 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:31.770248 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-41bfc1e6-0fe9-4bb5-98a2-7f4752f52c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:31.866424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 712/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:31.905017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a644c-ff1c-4960-9c2e-b23f6816a69a None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:31.906559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f61a644c-ff1c-4960-9c2e-b23f6816a69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:32.010720 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a644c-ff1c-4960-9c2e-b23f6816a69a None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:32.054368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:32.088736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:32.089394 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:32.089676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:32.089952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:32.091895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:32.201288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:32.202637 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795fff0-7246-4faf-a8ac-1b9bef1ce034 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:32.220320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 737/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:34.370787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd854-c0de-4800-bb50-ccf1a818676a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:34.371379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd854-c0de-4800-bb50-ccf1a818676a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:34.371379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd854-c0de-4800-bb50-ccf1a818676a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:34.372666 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 713/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:34.378724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced41f2-c603-4850-9dcb-ee777600291a None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:34.379154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced41f2-c603-4850-9dcb-ee777600291a None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:34.379311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced41f2-c603-4850-9dcb-ee777600291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:34.445246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0ced41f2-c603-4850-9dcb-ee777600291a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:34.446476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0ced41f2-c603-4850-9dcb-ee777600291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:34.467299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:34.542187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 738/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:34.582363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdd854-c0de-4800-bb50-ccf1a818676a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:34.583903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dcfdd854-c0de-4800-bb50-ccf1a818676a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:34.690113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdd854-c0de-4800-bb50-ccf1a818676a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:34.710651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:34.766038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:34.766651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:34.766933 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:34.767197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:34.768826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:34.877272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:34.879296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9b629-c624-46ef-bfbd-16f5c7fd1aa2 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:34.899026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 714/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:36.978184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47c0e-8325-4523-84c4-3e47f4ec13c7 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:36.978759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47c0e-8325-4523-84c4-3e47f4ec13c7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:36.978759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e47c0e-8325-4523-84c4-3e47f4ec13c7 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:36.980128 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 739/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:36.985809 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cb2f4-ce9f-47b4-a1bd-3054982f3520 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:36.986256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cb2f4-ce9f-47b4-a1bd-3054982f3520 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:36.986356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cb2f4-ce9f-47b4-a1bd-3054982f3520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:37.051525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:37.054360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-9e8cb2f4-ce9f-47b4-a1bd-3054982f3520 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:37.056150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-9e8cb2f4-ce9f-47b4-a1bd-3054982f3520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:37.151554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 715/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:37.190256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47c0e-8325-4523-84c4-3e47f4ec13c7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:37.192050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b5e47c0e-8325-4523-84c4-3e47f4ec13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:37.296285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e47c0e-8325-4523-84c4-3e47f4ec13c7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:37.344646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:37.370487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:37.371107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:37.371391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:37.371662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:37.373321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:37.611074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:37.613060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a602965-c829-4703-b5da-5fd5fb26e34f service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:37.631511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 740/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:39.736232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368c70-ca3e-4c68-ba27-11d8348c95c0 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:39.736773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368c70-ca3e-4c68-ba27-11d8348c95c0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:39.736920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368c70-ca3e-4c68-ba27-11d8348c95c0 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:39.738919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 716/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:39.744482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2e510-6e86-461d-930f-545dd9474e95 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:39.744941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2e510-6e86-461d-930f-545dd9474e95 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:39.745071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2e510-6e86-461d-930f-545dd9474e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:39.810748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-02f2e510-6e86-461d-930f-545dd9474e95 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:39.811960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-02f2e510-6e86-461d-930f-545dd9474e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:39.841167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:39.909842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 741/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:39.948103 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368c70-ca3e-4c68-ba27-11d8348c95c0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:39.949662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2f368c70-ca3e-4c68-ba27-11d8348c95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:40.053652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368c70-ca3e-4c68-ba27-11d8348c95c0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:40.082420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:40.129249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:40.129857 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:40.130130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:40.130395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:40.131997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:40.241321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:40.243043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83888a39-d0ee-4471-8625-4579d589be32 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:40.261833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 717/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:42.325240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c950-e31c-4fa0-8313-0a2a75935244 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:42.325761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c950-e31c-4fa0-8313-0a2a75935244 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:42.325761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17c950-e31c-4fa0-8313-0a2a75935244 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:42.327090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 742/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:42.332510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93dc0-18c0-4055-96aa-1e547f37583a None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:42.333026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93dc0-18c0-4055-96aa-1e547f37583a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:42.333122 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93dc0-18c0-4055-96aa-1e547f37583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:42.400796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-45d93dc0-18c0-4055-96aa-1e547f37583a None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:42.402043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-45d93dc0-18c0-4055-96aa-1e547f37583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:42.410808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:42.501101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 718/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:42.538152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17c950-e31c-4fa0-8313-0a2a75935244 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:42.539678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-be17c950-e31c-4fa0-8313-0a2a75935244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:42.641537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17c950-e31c-4fa0-8313-0a2a75935244 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:42.700885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:42.719577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:42.720205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:42.720486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:42.720762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:42.722971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:42.834048 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:42.835502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047acb-8fdb-4923-b03f-734bfc8cf94b service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:42.856070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 743/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:44.950692 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968117-b8e6-4767-80c3-43189b3dfcb4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:44.951174 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968117-b8e6-4767-80c3-43189b3dfcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:44.951271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968117-b8e6-4767-80c3-43189b3dfcb4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:44.952605 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 719/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:44.958523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e860c-eee6-4adc-84d4-543df907fa0c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:44.959099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e860c-eee6-4adc-84d4-543df907fa0c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:44.959099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e860c-eee6-4adc-84d4-543df907fa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:45.030977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ba8e860c-eee6-4adc-84d4-543df907fa0c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:45.032222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ba8e860c-eee6-4adc-84d4-543df907fa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:45.074078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:45.137774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 744/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:19:45.177070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02968117-b8e6-4767-80c3-43189b3dfcb4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:45.178602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-02968117-b8e6-4767-80c3-43189b3dfcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:45.284954 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02968117-b8e6-4767-80c3-43189b3dfcb4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:45.324563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:45.367086 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:45.367696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:45.367972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:45.368239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:45.369874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:45.479820 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:45.481302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028b847-a813-4a0d-9863-88f0d1a58a32 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:45.503908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 720/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:47.661478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65994d9-401d-4e4f-96c5-62c38db78063 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:47.662053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65994d9-401d-4e4f-96c5-62c38db78063 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:47.662053 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65994d9-401d-4e4f-96c5-62c38db78063 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:47.663375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 745/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:47.668695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8a39-23ee-4a3a-b374-180ac9e861bd None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:47.669299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8a39-23ee-4a3a-b374-180ac9e861bd None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:47.669299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e8a39-23ee-4a3a-b374-180ac9e861bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:47.737228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-839e8a39-23ee-4a3a-b374-180ac9e861bd None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:47.738468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-839e8a39-23ee-4a3a-b374-180ac9e861bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:47.757363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:47.837245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 721/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:47.874316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65994d9-401d-4e4f-96c5-62c38db78063 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:47.875852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d65994d9-401d-4e4f-96c5-62c38db78063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:47.978934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65994d9-401d-4e4f-96c5-62c38db78063 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:48.046483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:48.054669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:48.055300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:48.055608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:48.055878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:48.057584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:48.168983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:48.170446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852bc8a-c758-4e7e-80df-a65f3d56f3b8 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:48.189761 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 746/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:19:50.250437 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6f8c3-1d6b-4850-a65c-0df78c1e6a9b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:50.250970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6f8c3-1d6b-4850-a65c-0df78c1e6a9b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:50.250970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6f8c3-1d6b-4850-a65c-0df78c1e6a9b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:50.252281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 722/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:19:50.258383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859984-a9d0-40ee-9fcd-bb5c024be867 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:50.258864 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859984-a9d0-40ee-9fcd-bb5c024be867 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:50.258973 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0859984-a9d0-40ee-9fcd-bb5c024be867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:50.329770 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-f0859984-a9d0-40ee-9fcd-bb5c024be867 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:19:50.330986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f0859984-a9d0-40ee-9fcd-bb5c024be867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:50.382669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:50.435069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 747/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:19:50.472595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6f8c3-1d6b-4850-a65c-0df78c1e6a9b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:19:50.474159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6ce6f8c3-1d6b-4850-a65c-0df78c1e6a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:50.578955 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6f8c3-1d6b-4850-a65c-0df78c1e6a9b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:19:50.626034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:19:50.652600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:19:50.653243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:19:50.653521 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:19:50.653790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:19:50.655396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:19:50.778695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:19:50.780132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec4564-e09e-4b74-b1a0-5aabb6cc2a95 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:19:50.798644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 723/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:00.433005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=22 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:00.796307 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=66 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:10.642317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d557c1-d2c5-485f-b6a5-ffda21f4e055 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:10.642944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d557c1-d2c5-485f-b6a5-ffda21f4e055 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:10.642944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d557c1-d2c5-485f-b6a5-ffda21f4e055 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:10.644256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 748/1471] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:10.649913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0fd97-0404-43c6-82d8-47249e9a7b9c None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:10.650546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0fd97-0404-43c6-82d8-47249e9a7b9c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:10.650546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0fd97-0404-43c6-82d8-47249e9a7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:10.725251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-bcb0fd97-0404-43c6-82d8-47249e9a7b9c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:10.726490 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-bcb0fd97-0404-43c6-82d8-47249e9a7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:10.829133 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 724/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:10.919870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cfee-0a9f-4451-83c1-6a0138d0eb12 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:10.920143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cfee-0a9f-4451-83c1-6a0138d0eb12 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:10.920422 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cfee-0a9f-4451-83c1-6a0138d0eb12 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:10.921802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 749/1473] 10.222.0.18 () {54 vars in 966 bytes} [Tue Jul 26 10:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:10.927621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ebb3-0fcc-405c-89f4-8e22026b97c0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:10.927905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ebb3-0fcc-405c-89f4-8e22026b97c0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:10.928180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086ebb3-0fcc-405c-89f4-8e22026b97c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:11.008264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-2086ebb3-0fcc-405c-89f4-8e22026b97c0 None None] MFA Rules not processed for user `82bfade65449437b928932715d5e8a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:11.009514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2086ebb3-0fcc-405c-89f4-8e22026b97c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:11.029718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:11.085904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 725/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Tue Jul 26 10:20:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:20:11.094664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cfee-0a9f-4451-83c1-6a0138d0eb12 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:11.096908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e105cfee-0a9f-4451-83c1-6a0138d0eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:11.202566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cfee-0a9f-4451-83c1-6a0138d0eb12 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:11.283215 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82bfade65449437b928932715d5e8a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:11.283866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:11.284144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:11.284413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:11.286079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:11.341593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:11.397349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:11.398787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a61d47-e8b2-4ff6-965c-be56586d592f service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:11.417271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 750/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:13.520082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1f3b-df91-4731-9f3a-63a08ecf11d5 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:13.520813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1f3b-df91-4731-9f3a-63a08ecf11d5 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:13.520813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1f3b-df91-4731-9f3a-63a08ecf11d5 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:13.522283 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 726/1476] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:13.527893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1abc-8296-4d97-b05d-5aa5c590339e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:13.528348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1abc-8296-4d97-b05d-5aa5c590339e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:13.528447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd1abc-8296-4d97-b05d-5aa5c590339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:13.600829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-4dcd1abc-8296-4d97-b05d-5aa5c590339e None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:13.602126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4dcd1abc-8296-4d97-b05d-5aa5c590339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:13.714243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 751/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:13.738004 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1f3b-df91-4731-9f3a-63a08ecf11d5 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:13.739545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-024b1f3b-df91-4731-9f3a-63a08ecf11d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:13.874698 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1f3b-df91-4731-9f3a-63a08ecf11d5 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:13.925982 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:13.982186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:13.982806 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:13.983081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:13.983353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:13.984316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:13.986145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:20:13.986145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:20:13.986145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:20:13.987444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3facc849-447a-42dd-b034-92a031d8d5ad admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:14.007314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 727/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Jul 26 10:20:13 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:20:16.086797 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfee617-ce99-435a-b02e-c4d70e49835f None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:16.087354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfee617-ce99-435a-b02e-c4d70e49835f None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:16.087354 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfee617-ce99-435a-b02e-c4d70e49835f None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:16.088717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 752/1479] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:16.094026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e69364-fec9-4d7c-a000-c9946bac9c9f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:16.094474 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e69364-fec9-4d7c-a000-c9946bac9c9f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:16.094584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e69364-fec9-4d7c-a000-c9946bac9c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:16.161202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-d2e69364-fec9-4d7c-a000-c9946bac9c9f None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:16.162415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d2e69364-fec9-4d7c-a000-c9946bac9c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:16.258063 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 728/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:16.301411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfee617-ce99-435a-b02e-c4d70e49835f None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:16.303141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1dfee617-ce99-435a-b02e-c4d70e49835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:16.312950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:16.446158 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfee617-ce99-435a-b02e-c4d70e49835f None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:16.525303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:16.558840 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:16.559519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:16.560033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:16.560531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:16.562654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:16.650428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:16.652036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e4245-dc2b-44fb-98db-017152678722 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:16.669748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 753/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:18.872684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b17670-e28f-4ab9-bc85-01466d436c5f None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:18.873256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b17670-e28f-4ab9-bc85-01466d436c5f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:18.873256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b17670-e28f-4ab9-bc85-01466d436c5f None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:18.874616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 729/1482] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:18.880033 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dbe66-5f37-4fdc-b733-3c9c38be7735 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:18.880472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dbe66-5f37-4fdc-b733-3c9c38be7735 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:18.880577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dbe66-5f37-4fdc-b733-3c9c38be7735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:18.946157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5d3dbe66-5f37-4fdc-b733-3c9c38be7735 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:18.947293 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5d3dbe66-5f37-4fdc-b733-3c9c38be7735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:18.993216 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:19.044326 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 754/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:19.080938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b17670-e28f-4ab9-bc85-01466d436c5f None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:19.082464 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f6b17670-e28f-4ab9-bc85-01466d436c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:19.107494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:19.197123 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b17670-e28f-4ab9-bc85-01466d436c5f None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:19.271212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:19.271826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:19.272105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:19.272379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:19.274023 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:19.349819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:19.384859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:19.386321 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c08c6-1891-422a-a3d3-7426c9f94479 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:19.404537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 730/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:21.477580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115b285-111b-4596-aee3-4983f6f44d14 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:21.478059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115b285-111b-4596-aee3-4983f6f44d14 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:21.478171 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115b285-111b-4596-aee3-4983f6f44d14 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:21.479467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 755/1485] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:21.484944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd1135-e300-4052-990b-550a48e289db None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:21.485382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd1135-e300-4052-990b-550a48e289db None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:21.485489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd1135-e300-4052-990b-550a48e289db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:21.550573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-35bd1135-e300-4052-990b-550a48e289db None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:21.551784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-35bd1135-e300-4052-990b-550a48e289db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:21.650390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 731/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:21.689382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115b285-111b-4596-aee3-4983f6f44d14 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:21.690936 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4115b285-111b-4596-aee3-4983f6f44d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:21.793735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115b285-111b-4596-aee3-4983f6f44d14 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:21.864302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:21.866403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:21.867085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:21.867579 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:21.867889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:21.869964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:21.986332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:21.987804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca8e6a7-90e0-47c3-934f-78f8485a182c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:22.007680 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 756/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:24.162162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea809-f44c-42c6-9e62-b1359435eeb6 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:24.162736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea809-f44c-42c6-9e62-b1359435eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:24.162736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ea809-f44c-42c6-9e62-b1359435eeb6 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:24.164051 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 732/1488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:24.169203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375989b-ccdc-4679-be17-89601ad4cf6c None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:24.169655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375989b-ccdc-4679-be17-89601ad4cf6c None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:24.169760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375989b-ccdc-4679-be17-89601ad4cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:24.236300 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-1375989b-ccdc-4679-be17-89601ad4cf6c None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:24.237608 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1375989b-ccdc-4679-be17-89601ad4cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:24.289783 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:24.333737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 757/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:24.374189 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea809-f44c-42c6-9e62-b1359435eeb6 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:24.375710 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0f9ea809-f44c-42c6-9e62-b1359435eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:24.412393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:24.482050 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ea809-f44c-42c6-9e62-b1359435eeb6 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:24.555001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:24.555611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:24.555887 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:24.556153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:24.557784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:24.638087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:24.667870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:24.669265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819042bf-edbe-4d18-9b89-5f6b6150e9a9 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:24.686780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 733/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:26.984717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575969-fafd-4aa7-8ab0-07d14bbabecc None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:26.985244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575969-fafd-4aa7-8ab0-07d14bbabecc None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:26.985368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4575969-fafd-4aa7-8ab0-07d14bbabecc None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:26.987277 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 758/1491] 10.222.0.18 () {54 vars in 926 bytes} [Tue Jul 26 10:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:20:26.992423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbb0e2-566e-4eb5-82e3-257df08e1690 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:26.992875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbb0e2-566e-4eb5-82e3-257df08e1690 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:26.992994 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbb0e2-566e-4eb5-82e3-257df08e1690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:27.059467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-04bbb0e2-566e-4eb5-82e3-257df08e1690 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:20:27.060677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-04bbb0e2-566e-4eb5-82e3-257df08e1690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:27.156360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 734/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Jul 26 10:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:20:27.194593 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4575969-fafd-4aa7-8ab0-07d14bbabecc None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:20:27.196136 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-b4575969-fafd-4aa7-8ab0-07d14bbabecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:27.302739 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4575969-fafd-4aa7-8ab0-07d14bbabecc None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:20:27.383226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:20:27.383838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:20:27.384115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:20:27.384383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:20:27.386025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:20:27.395497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:27.495099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:20:27.496523 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4644-342d-4c5a-9df6-9d6bb6a81b11 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:20:27.514502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 759/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:20:37.154433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=82 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:20:37.512195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=50 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:55.885323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:55.885929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:55.885929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:55.963085 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:21:55.964240 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:56.068447 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 735/1494] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:21:56.082823 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:56.088968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:56.088968 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:56.164565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:21:56.165852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:56.271765 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 760/1495] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:21:56.276468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:56.277743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:56.289662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e68e3f-3460-4b44-b362-1d9fb21e0763 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:56.352329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:56.386913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:56.387583 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:56.387856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:56.388124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:56.388802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:21:56.389131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:56.390134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:56.390134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:21:56.390134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:21:56.394036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:56.402535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 736/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Jul 26 10:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:21:56.411776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:56.421113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049eeeb0-11c0-497a-8b62-1979d728f746 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:56.481856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:56.516306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:56.516950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:56.517234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:56.517510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:56.518182 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:56.519907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:56.519907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:21:56.519907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:21:56.521137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:56.576786 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 761/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 10:21:56 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:21:56.581099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:56.582664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:56.616504 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a5832-562c-4426-8fa6-2321ce14c6ce admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:56.713511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:56.714155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:56.714434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:56.714705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:56.715371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:56.716379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:56.716379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:21:56.716379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:21:56.717636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:56.765113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 737/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:21:56 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:21:56.769203 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:56.770709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:56.832774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf2d9-8eb1-4a2c-b33e-b2ea0859ac07 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:56.915357 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:56.926753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:56.927375 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:56.927654 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:56.927931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:56.928624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:56.929756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:56.929756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:21:56.929756 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:21:56.930632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:56.943622 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 762/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:21:56.947990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:56.949536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:56.961639 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5724c2-3f42-4a7c-9696-1c537df52088 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:56.986346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:57.056705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:57.057359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.057642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.057908 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.058599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:57.059611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:57.059611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:21:57.059611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:21:57.060492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b566d-207a-4582-a90a-ab9fa79912ef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:57.073657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 738/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:21:57.077992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:57.079524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:57.116599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ae20-5a9b-404c-ae49-484c535b9f1d admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:57.208537 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:57.209236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.209514 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.209787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] PATH_INFO: `/v3/projects/c6edb582ae3f46ec863878df20885878/users/56345b3f402042e185e76dd6c8f40fcf/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.230953 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6edb582ae3f46ec863878df20885878, user_id=56345b3f402042e185e76dd6c8f40fcf, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:57.231969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:57.231969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:21:57.231969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:21:57.233956 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60faa1-8fd9-4416-b37c-6a4eaf4d384c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:57.259358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 763/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:21:57 2022] PUT /identity/v3/projects/c6edb582ae3f46ec863878df20885878/users/56345b3f402042e185e76dd6c8f40fcf/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:21:57.271538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0318-4e81-4b17-a156-7d95c6f9759b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.271829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0318-4e81-4b17-a156-7d95c6f9759b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.272104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a0318-4e81-4b17-a156-7d95c6f9759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.328420 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-445a0318-4e81-4b17-a156-7d95c6f9759b None None] MFA Rules not processed for user `56345b3f402042e185e76dd6c8f40fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:21:57.329657 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-445a0318-4e81-4b17-a156-7d95c6f9759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:57.406928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 739/1502] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:21:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:21:57.419843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9eff-5c04-47e9-a882-8a86679ef5ed None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.420134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9eff-5c04-47e9-a882-8a86679ef5ed None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.420411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff9eff-5c04-47e9-a882-8a86679ef5ed None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.422406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 764/1503] 10.222.0.18 () {54 vars in 964 bytes} [Tue Jul 26 10:21:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:21:57.427035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a4b3-0d57-4de1-b723-acf29e9a486b None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.427322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a4b3-0d57-4de1-b723-acf29e9a486b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.427595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717a4b3-0d57-4de1-b723-acf29e9a486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.457435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:57.501668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a717a4b3-0d57-4de1-b723-acf29e9a486b None None] MFA Rules not processed for user `0c3969e48a534d8babef2991941c01bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:21:57.502862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a717a4b3-0d57-4de1-b723-acf29e9a486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:57.580884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 740/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Jul 26 10:21:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:21:57.588886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9eff-5c04-47e9-a882-8a86679ef5ed None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:57.590548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-deff9eff-5c04-47e9-a882-8a86679ef5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:57.643230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:57.703200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff9eff-5c04-47e9-a882-8a86679ef5ed None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:57.780801 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3969e48a534d8babef2991941c01bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:57.782022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.782299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.782588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.784214 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:57.885186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:57.886621 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:57.890177 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:57.906100 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 765/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:21:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:21:57.951627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b39c1-ca1f-4ef7-aab4-2082a03ad024 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:57.952079 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b39c1-ca1f-4ef7-aab4-2082a03ad024 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:57.952234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b39c1-ca1f-4ef7-aab4-2082a03ad024 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:57.954126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 741/1506] 10.222.0.18 () {52 vars in 830 bytes} [Tue Jul 26 10:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:21:57.957749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:57.958963 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:58.059790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8050c4-8d5f-4133-9397-588f7004002d service cinder] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:58.163928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:58.164617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:58.164827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:58.165125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] PATH_INFO: `/v3/users/56345b3f402042e185e76dd6c8f40fcf` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:58.177683 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56345b3f402042e185e76dd6c8f40fcf)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:58.178705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:58.178705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:21:58.178705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:21:58.179911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:58.190058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:58.247614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56345b3f402042e185e76dd6c8f40fcf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:58.257467 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56345b3f402042e185e76dd6c8f40fcf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:58.269858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56345b3f402042e185e76dd6c8f40fcf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:58.270296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56345b3f402042e185e76dd6c8f40fcf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:58.270802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56345b3f402042e185e76dd6c8f40fcf'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:58.294462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 766/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 10:21:57 2022] DELETE /identity/v3/users/56345b3f402042e185e76dd6c8f40fcf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:21:58.298874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:58.299164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:58.299443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:58.357092 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:21:58.358356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:58.443746 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:58.458115 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 742/1508] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:21:58.467940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:58.469486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:58.571871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b640254-b641-4b58-a156-0ca37f99b64a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:58.625870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:21:58.647774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:58.648404 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:58.648687 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:58.648996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:58.650633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:58.767279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:58.768767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b308e11-0222-4a3e-993c-e1d0730a67bc service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:58.791564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 767/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:21:59.157162 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:21:59.158399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:21:59.169924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0700b65-8b8a-42f1-95fc-466e9fb5b1d3 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:21:59.270124 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:21:59.270777 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:21:59.271060 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:21:59.271331 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] PATH_INFO: `/v3/projects/c6edb582ae3f46ec863878df20885878` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:21:59.281981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6edb582ae3f46ec863878df20885878)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:21:59.283014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:21:59.283014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:21:59.283014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:21:59.284224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:21:59.346732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6edb582ae3f46ec863878df20885878', 'request_id': 'req-2f194000-3da3-4711-96b6-5aff5f1a9f63'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:59.360288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6edb582ae3f46ec863878df20885878', 'request_id': 'req-2f194000-3da3-4711-96b6-5aff5f1a9f63'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:59.369728 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6edb582ae3f46ec863878df20885878', 'request_id': 'req-2f194000-3da3-4711-96b6-5aff5f1a9f63'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:59.392674 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] The token cache is being invalidate because project c6edb582ae3f46ec863878df20885878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:21:59.393075 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:59.393614 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-2f194000-3da3-4711-96b6-5aff5f1a9f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:21:59.394952 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 743/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 10:21:59 2022] DELETE /identity/v3/projects/c6edb582ae3f46ec863878df20885878 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:22:08.788109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=62 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:22:09.389983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:11.968002 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efc77-6249-49d3-861d-edbe5ce89870 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:11.968559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efc77-6249-49d3-861d-edbe5ce89870 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:11.968559 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444efc77-6249-49d3-861d-edbe5ce89870 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:11.970014 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 768/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:11.975703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc57c5-e7ce-4964-ad1c-78de82d39e85 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:11.976184 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc57c5-e7ce-4964-ad1c-78de82d39e85 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:11.976299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc57c5-e7ce-4964-ad1c-78de82d39e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:12.059688 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-00dc57c5-e7ce-4964-ad1c-78de82d39e85 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:12.060938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-00dc57c5-e7ce-4964-ad1c-78de82d39e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:12.164070 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 744/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:12.318259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efc77-6249-49d3-861d-edbe5ce89870 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:12.320384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-444efc77-6249-49d3-861d-edbe5ce89870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:12.436866 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444efc77-6249-49d3-861d-edbe5ce89870 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:12.442884 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb14752-0a13-47a8-8678-58e316460739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:12.443513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14752-0a13-47a8-8678-58e316460739 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:12.443790 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14752-0a13-47a8-8678-58e316460739 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:12.444067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14752-0a13-47a8-8678-58e316460739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:12.452205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb14752-0a13-47a8-8678-58e316460739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:12.453813 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb14752-0a13-47a8-8678-58e316460739 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:12.464362 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 769/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:13.304005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a189549-a1f5-423a-8842-3d4f75938de4 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:13.304545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a189549-a1f5-423a-8842-3d4f75938de4 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:13.304545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a189549-a1f5-423a-8842-3d4f75938de4 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:13.305862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 745/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:13.310903 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2299-9586-4def-87e2-c7245e09061b None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:13.311358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2299-9586-4def-87e2-c7245e09061b None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:13.311574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2299-9586-4def-87e2-c7245e09061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:13.331198 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-078a2299-9586-4def-87e2-c7245e09061b None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:13.332413 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-078a2299-9586-4def-87e2-c7245e09061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:13.340356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 770/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:13.492508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a189549-a1f5-423a-8842-3d4f75938de4 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:13.507017 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a189549-a1f5-423a-8842-3d4f75938de4 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:13.512469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35272b-0e24-4d0f-a5cb-b4ebcc475376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:13.513109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35272b-0e24-4d0f-a5cb-b4ebcc475376 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:13.513391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35272b-0e24-4d0f-a5cb-b4ebcc475376 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:13.513664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35272b-0e24-4d0f-a5cb-b4ebcc475376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:13.522682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35272b-0e24-4d0f-a5cb-b4ebcc475376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:13.525558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35272b-0e24-4d0f-a5cb-b4ebcc475376 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:13.538145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 746/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:23:16.204121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269bb94-95fa-4b16-9b51-5e0c6c439511 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:16.204672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269bb94-95fa-4b16-9b51-5e0c6c439511 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:16.204672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269bb94-95fa-4b16-9b51-5e0c6c439511 None None] PATH_INFO: `/v3` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:16.205931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 771/1517] 10.222.0.58 () {54 vars in 925 bytes} [Tue Jul 26 10:23:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 10:23:16.211992 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85af7-7612-4f78-a58e-9aca3145d071 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:16.212432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85af7-7612-4f78-a58e-9aca3145d071 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:16.212538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc85af7-7612-4f78-a58e-9aca3145d071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:16.273690 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8bc85af7-7612-4f78-a58e-9aca3145d071 None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:16.274901 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8bc85af7-7612-4f78-a58e-9aca3145d071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:16.293151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:16.348846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 747/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Jul 26 10:23:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:23.326245 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=56 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:24.809031 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d05e-c81c-4a9b-8ec5-51362a5db524 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:24.809693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d05e-c81c-4a9b-8ec5-51362a5db524 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:24.809693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681d05e-c81c-4a9b-8ec5-51362a5db524 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:24.810877 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 772/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:24.817642 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f0fd4-57d6-42de-9838-f84ebd4b50a8 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:24.818148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f0fd4-57d6-42de-9838-f84ebd4b50a8 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:24.818269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f0fd4-57d6-42de-9838-f84ebd4b50a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:24.839303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-4c6f0fd4-57d6-42de-9838-f84ebd4b50a8 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:24.840796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-4c6f0fd4-57d6-42de-9838-f84ebd4b50a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:24.848987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 748/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:25.006243 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d05e-c81c-4a9b-8ec5-51362a5db524 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:25.021506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681d05e-c81c-4a9b-8ec5-51362a5db524 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:25.027209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c28a9-9ee0-4060-9bdb-2fa1ec6c0424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:25.027838 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c28a9-9ee0-4060-9bdb-2fa1ec6c0424 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:25.028126 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c28a9-9ee0-4060-9bdb-2fa1ec6c0424 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:25.028401 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c28a9-9ee0-4060-9bdb-2fa1ec6c0424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:25.037469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c28a9-9ee0-4060-9bdb-2fa1ec6c0424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:25.039069 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c28a9-9ee0-4060-9bdb-2fa1ec6c0424 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:25.051528 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 773/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:25.216628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2b4cb-33f2-4433-87d0-45d092ba5c6b None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:25.216946 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2b4cb-33f2-4433-87d0-45d092ba5c6b None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:25.217225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2b4cb-33f2-4433-87d0-45d092ba5c6b None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:25.218798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 749/1522] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 26 10:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:25.224330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6e76-29da-426b-b1c3-59e82cd33607 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:25.224616 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6e76-29da-426b-b1c3-59e82cd33607 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:25.224923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db6e76-29da-426b-b1c3-59e82cd33607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:25.245878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-01db6e76-29da-426b-b1c3-59e82cd33607 None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:25.247097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-01db6e76-29da-426b-b1c3-59e82cd33607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:25.256546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 774/1523] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 26 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:25.264377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2b4cb-33f2-4433-87d0-45d092ba5c6b None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:25.277904 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2b4cb-33f2-4433-87d0-45d092ba5c6b None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:25.283399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66744-1577-4ca7-872d-41299037441c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:25.284089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66744-1577-4ca7-872d-41299037441c service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:25.284461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66744-1577-4ca7-872d-41299037441c service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:25.284735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66744-1577-4ca7-872d-41299037441c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:25.293883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66744-1577-4ca7-872d-41299037441c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:25.295465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66744-1577-4ca7-872d-41299037441c service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:25.307778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 750/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:25.892753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b451e6-541c-4773-a187-2d3931d66fa0 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:25.893305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b451e6-541c-4773-a187-2d3931d66fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:25.893305 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b451e6-541c-4773-a187-2d3931d66fa0 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:25.894815 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 775/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 10:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:23:25.899998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de959c-eb8c-4227-8e58-a4da82369143 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:25.900509 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de959c-eb8c-4227-8e58-a4da82369143 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:25.900604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de959c-eb8c-4227-8e58-a4da82369143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:25.922859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-05de959c-eb8c-4227-8e58-a4da82369143 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:25.924173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-05de959c-eb8c-4227-8e58-a4da82369143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:25.932061 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 751/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:26.089928 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b451e6-541c-4773-a187-2d3931d66fa0 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:26.105460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b451e6-541c-4773-a187-2d3931d66fa0 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:26.111345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1f30f-a617-42d8-b8bd-56b4829900e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:26.111972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f30f-a617-42d8-b8bd-56b4829900e2 service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:26.112255 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f30f-a617-42d8-b8bd-56b4829900e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:26.112532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1f30f-a617-42d8-b8bd-56b4829900e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:26.121369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1f30f-a617-42d8-b8bd-56b4829900e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:26.122959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1f30f-a617-42d8-b8bd-56b4829900e2 service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:26.133489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 776/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:23:30.209816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392003c2-c51f-4198-8893-236ab5b06e0a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:30.210391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392003c2-c51f-4198-8893-236ab5b06e0a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:30.210391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392003c2-c51f-4198-8893-236ab5b06e0a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:30.211682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 752/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:30.217623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fcd66-3d26-4233-aea2-0f3183dd0831 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:30.218439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fcd66-3d26-4233-aea2-0f3183dd0831 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:30.218617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fcd66-3d26-4233-aea2-0f3183dd0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:30.240678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-119fcd66-3d26-4233-aea2-0f3183dd0831 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:30.242091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-119fcd66-3d26-4233-aea2-0f3183dd0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:30.250280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 777/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:30.337080 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392003c2-c51f-4198-8893-236ab5b06e0a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:30.340631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-392003c2-c51f-4198-8893-236ab5b06e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:30.443900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392003c2-c51f-4198-8893-236ab5b06e0a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:30.448145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d3b35-7f58-43ab-82f4-81666c823c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:30.448791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d3b35-7f58-43ab-82f4-81666c823c06 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:30.449106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d3b35-7f58-43ab-82f4-81666c823c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:30.449381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d3b35-7f58-43ab-82f4-81666c823c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:30.460700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d3b35-7f58-43ab-82f4-81666c823c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:30.462121 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d3b35-7f58-43ab-82f4-81666c823c06 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:30.472818 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 753/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:32.611602 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e564c95-6403-4edf-a5d2-b3e239de9831 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:32.612257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e564c95-6403-4edf-a5d2-b3e239de9831 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:32.612257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e564c95-6403-4edf-a5d2-b3e239de9831 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:32.613624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 778/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:23:32.619653 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d881cf-c037-42e4-b04d-ac5f7cbfbe68 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:32.620323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d881cf-c037-42e4-b04d-ac5f7cbfbe68 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:32.620323 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d881cf-c037-42e4-b04d-ac5f7cbfbe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:32.642419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-96d881cf-c037-42e4-b04d-ac5f7cbfbe68 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:32.643667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-96d881cf-c037-42e4-b04d-ac5f7cbfbe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:32.651845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 754/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:23:32.693915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e564c95-6403-4edf-a5d2-b3e239de9831 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:32.696400 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3e564c95-6403-4edf-a5d2-b3e239de9831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:32.713261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e564c95-6403-4edf-a5d2-b3e239de9831 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:32.719487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af259ef0-7a8d-4861-9498-071df5d84fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:32.721058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259ef0-7a8d-4861-9498-071df5d84fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:32.721543 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259ef0-7a8d-4861-9498-071df5d84fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:32.722035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af259ef0-7a8d-4861-9498-071df5d84fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:32.740391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259ef0-7a8d-4861-9498-071df5d84fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:32.743282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af259ef0-7a8d-4861-9498-071df5d84fe2 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:32.761643 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 779/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:36.456696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864d954-e2aa-441e-94c5-b38744bc223d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:36.457448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864d954-e2aa-441e-94c5-b38744bc223d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:36.457448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864d954-e2aa-441e-94c5-b38744bc223d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:36.458662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 755/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:23:36.464636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf12a8d-aada-4189-97a3-df63a43ddbc5 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:36.465212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf12a8d-aada-4189-97a3-df63a43ddbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:36.465212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf12a8d-aada-4189-97a3-df63a43ddbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:36.487268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-3cf12a8d-aada-4189-97a3-df63a43ddbc5 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:36.488517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-3cf12a8d-aada-4189-97a3-df63a43ddbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:36.496794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 780/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:23:37.049202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864d954-e2aa-441e-94c5-b38744bc223d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:37.051005 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f864d954-e2aa-441e-94c5-b38744bc223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:37.130492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:37.147135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864d954-e2aa-441e-94c5-b38744bc223d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:37.150927 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04bdf2-8a1e-4a75-b759-88077c9ce5cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3969e48a534d8babef2991941c01bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:37.151574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04bdf2-8a1e-4a75-b759-88077c9ce5cd service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:37.151858 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04bdf2-8a1e-4a75-b759-88077c9ce5cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:37.152137 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04bdf2-8a1e-4a75-b759-88077c9ce5cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:37.163238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04bdf2-8a1e-4a75-b759-88077c9ce5cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:37.164726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04bdf2-8a1e-4a75-b759-88077c9ce5cd service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:37.176711 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 756/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:23:39.335785 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9900d83-1a8d-4604-b2c2-8f817bec06c9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:39.336592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9900d83-1a8d-4604-b2c2-8f817bec06c9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:39.336795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9900d83-1a8d-4604-b2c2-8f817bec06c9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:39.339595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 781/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 10:23:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:23:39.348319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991825d-9cf4-4266-b03a-b0851df74e14 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:39.349101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991825d-9cf4-4266-b03a-b0851df74e14 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:39.349101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991825d-9cf4-4266-b03a-b0851df74e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:39.371529 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5991825d-9cf4-4266-b03a-b0851df74e14 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:23:39.372780 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5991825d-9cf4-4266-b03a-b0851df74e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:39.381742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 757/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 10:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:23:39.809153 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9900d83-1a8d-4604-b2c2-8f817bec06c9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:23:39.811743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-c9900d83-1a8d-4604-b2c2-8f817bec06c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:23:39.839343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9900d83-1a8d-4604-b2c2-8f817bec06c9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:23:39.845911 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e56af5-2378-46db-972a-bc5615af7915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3969e48a534d8babef2991941c01bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:23:39.846697 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56af5-2378-46db-972a-bc5615af7915 service cinder] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:23:39.847093 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56af5-2378-46db-972a-bc5615af7915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:23:39.847471 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e56af5-2378-46db-972a-bc5615af7915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:23:39.858628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e56af5-2378-46db-972a-bc5615af7915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:23:39.860460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e56af5-2378-46db-972a-bc5615af7915 service cinder] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:23:39.872589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 782/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:23:49.365900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=11 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:23:49.867077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=33 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:02.863700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5f3b3-d460-4337-b318-a7a0d97fce70 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:02.864318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5f3b3-d460-4337-b318-a7a0d97fce70 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:02.864318 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5f3b3-d460-4337-b318-a7a0d97fce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:02.880570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec976db-b90e-4dfe-bd0a-65ae84326435 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:02.881186 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec976db-b90e-4dfe-bd0a-65ae84326435 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:02.881324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec976db-b90e-4dfe-bd0a-65ae84326435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:02.885325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-6be5f3b3-d460-4337-b318-a7a0d97fce70 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:02.886540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-6be5f3b3-d460-4337-b318-a7a0d97fce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:02.895896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 758/1540] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:02.901241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-6ec976db-b90e-4dfe-bd0a-65ae84326435 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:02.902486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-6ec976db-b90e-4dfe-bd0a-65ae84326435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:02.905749 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:02.906155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:02.906325 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:02.911235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 783/1541] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:02.921234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:02.922615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:02.922615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:02.930206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:02.931434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:02.939473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 759/1542] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:02.944094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:02.944333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:02.945518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:02.955278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28c943-8bd4-4aa8-85cd-1e88f16a4817 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:02.960006 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:02.960191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 784/1543] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:02.960632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:02.960983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:02.961224 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] PATH_INFO: `/v3/domains` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:02.961900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:25:02.962202 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:02.963841 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:02.965520 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:02.975854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651685d1-1968-4b8e-83db-79755d9f1730 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:02.977402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 760/1544] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Jul 26 10:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:25:02.981010 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:02.981646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:02.981961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:02.982205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] PATH_INFO: `/v3/domains` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:02.982925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 10:25:02.983234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:02.984260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:02.984260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:25:02.984260 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:25:02.985191 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:02.985380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:02.995681 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6ef05-30ea-4d0f-9a9d-bd0c64575011 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.002380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 785/1545] 10.222.0.18 () {58 vars in 1153 bytes} [Tue Jul 26 10:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 10:25:03.002538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.002538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.002538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.002538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.002915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.004112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:03.004112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:25:03.004112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:25:03.005544 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.005748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.016282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc8d53-4ef5-4cfa-9ae2-a7038b5a7862 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.020989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.021615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.021895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.022167 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.022834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.024740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.053580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 761/1546] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:02 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:03.055151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 786/1547] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:03 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:03.058097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.058895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.123774 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa55674-b358-4011-bdce-c8394b98fefb admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.125377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99829222-95f7-463f-bb47-aa33cd522401 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.130082 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.130369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.130718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.130986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.131179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.131334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.131530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.132212 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.132481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.133250 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.134356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.134510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:03.134510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:25:03.134510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:25:03.135898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.158518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 762/1548] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:03 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 10:25:03.161721 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 787/1549] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:03 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:03.162685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.163886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.172872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa2b27-92f1-4ee6-b3d3-17cab5344345 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.173726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910c5f2-7e8c-4fc8-a5b8-d9dc7ccf08d2 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.178337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.178950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.179257 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.179427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814af34-568f-482b-9517-73f994423411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.179577 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.180047 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814af34-568f-482b-9517-73f994423411 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.180209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.180359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814af34-568f-482b-9517-73f994423411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.180588 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814af34-568f-482b-9517-73f994423411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.181346 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814af34-568f-482b-9517-73f994423411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.181983 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.182915 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814af34-568f-482b-9517-73f994423411 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.195434 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 788/1550] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:03.195651 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 763/1551] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:03.196511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.196828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814af34-568f-482b-9517-73f994423411 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.206615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed72600-27e2-4dd8-9f93-9929795c33ca admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.206831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814af34-568f-482b-9517-73f994423411 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.211190 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.211399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.211788 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.212000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.212099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.212280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.212392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.212554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.213030 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.213270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.214611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.214856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.225924 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 764/1552] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:03.226852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 789/1553] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:03.230040 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.230713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.240107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204822e-fadf-41ee-b0f7-897a03470951 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.240525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda447c-21fe-48e5-9d5d-888d76d7dc04 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.244923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.245207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2385394-2a14-46d8-89eb-f534775959f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.245578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.245920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.246113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2385394-2a14-46d8-89eb-f534775959f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.246304 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] PATH_INFO: `/v3/projects/63ca665a2ea84af181a71d3fb61b8f56/users/2729788a5dfe4bf983410566d3026412/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.246423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2385394-2a14-46d8-89eb-f534775959f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.246423 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2385394-2a14-46d8-89eb-f534775959f2 admin admin] PATH_INFO: `/v3/projects/97a2b5985dcf4ba9b8c28e305c857381/users/db37665594e64bef995ef708f0e84546/roles/1fbe89ae01d844ef881e25c4ac0ed9c7` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.261655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2385394-2a14-46d8-89eb-f534775959f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a2b5985dcf4ba9b8c28e305c857381, user_id=db37665594e64bef995ef708f0e84546, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.261883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ca665a2ea84af181a71d3fb61b8f56, user_id=2729788a5dfe4bf983410566d3026412, role_id=1fbe89ae01d844ef881e25c4ac0ed9c7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.262771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:25:03.262771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:25:03.262771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:25:03.264934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2385394-2a14-46d8-89eb-f534775959f2 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.265448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4375-0feb-47d2-a7f2-be099b0d04a3 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.282829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 765/1554] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:03 2022] PUT /identity/v3/projects/63ca665a2ea84af181a71d3fb61b8f56/users/2729788a5dfe4bf983410566d3026412/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:03.284950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 790/1555] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:03 2022] PUT /identity/v3/projects/97a2b5985dcf4ba9b8c28e305c857381/users/db37665594e64bef995ef708f0e84546/roles/1fbe89ae01d844ef881e25c4ac0ed9c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:25:03.289578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.289881 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.290109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.290970 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.291262 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.291682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.312778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:03.313898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] MFA Rules not processed for user `3f82692456794f98aaedf11a512d650d`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:03.314094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:03.315176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:03.358862 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:03.369150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:03.380043 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 766/1556] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:03.384333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 791/1557] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:03.391532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.394784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:03.468985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0467671-a47b-4c6f-a63f-802a85002cb2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.472631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70d662-78fa-4892-a541-8ea3ab6a4ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.473161 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7abb3-06cb-4bd0-bedb-81ecd1066124 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:03.473296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d662-78fa-4892-a541-8ea3ab6a4ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.473573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d662-78fa-4892-a541-8ea3ab6a4ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.473842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70d662-78fa-4892-a541-8ea3ab6a4ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.479333 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:03.480104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:03.480450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:03.480736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:03.483546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70d662-78fa-4892-a541-8ea3ab6a4ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.485232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70d662-78fa-4892-a541-8ea3ab6a4ec8 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.492107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:03.493705 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:03.500542 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 767/1558] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:03.505429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 792/1559] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:08.455145 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:08.455925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:08.455925 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:08.511316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] MFA Rules not processed for user `2729788a5dfe4bf983410566d3026412`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:08.513155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:08.627233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:08.628571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 768/1560] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:08.637712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2749d-8d3f-48d0-ad53-d299c3f24b01 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:08.653775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:08.654571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:08.654929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:08.655146 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:08.655847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:08.658041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:08.713600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:08.719409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 793/1561] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:08 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:08.725853 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656cbaf-0754-461d-8ec3-7ab57e4fc1e0 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:08.803188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:08.804164 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:08.804285 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:08.804892 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:08.805735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:08.809223 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:08.844611 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:08.856627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 769/1562] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:08 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:08.859351 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208ca90-3abf-4fd3-a9b8-4fb6edc2ee8c admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:08.865716 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:08.866369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:08.866800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:08.867090 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:08.867980 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:08.869804 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:08.890141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 794/1563] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:08.890837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:08.903613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5025b-ef72-4b72-a5f6-f69e0b2546d7 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:08.909361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:08.910382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:08.910564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:08.910985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] PATH_INFO: `/v3/projects/a0b389ef8a914d3fb13173696607c469/users/22a95b7a84954f5682d15c6a6bea1b2f/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:08.914859 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:08.930842 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b389ef8a914d3fb13173696607c469, user_id=22a95b7a84954f5682d15c6a6bea1b2f, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:08.933847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:08.958519 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 770/1564] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:08 2022] PUT /identity/v3/projects/a0b389ef8a914d3fb13173696607c469/users/22a95b7a84954f5682d15c6a6bea1b2f/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:08.958795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:08.978636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a17fb8-68e5-4d25-a0d8-f70f1c5c080a admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:09.088247 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1ef77-f8cc-4b62-8083-73cc51a10726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:09.089197 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ef77-f8cc-4b62-8083-73cc51a10726 admin admin] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:09.089492 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ef77-f8cc-4b62-8083-73cc51a10726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:09.089769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1ef77-f8cc-4b62-8083-73cc51a10726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:09.090923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ef77-f8cc-4b62-8083-73cc51a10726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:09.094066 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1ef77-f8cc-4b62-8083-73cc51a10726 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:09.115753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 795/1565] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:09.120183 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:09.132446 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647ee81-024a-4c31-9e19-896c1f158b2e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:09.139094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:09.141239 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:09.141564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:09.141773 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] PATH_INFO: `/v3/projects/a0b389ef8a914d3fb13173696607c469/users/22a95b7a84954f5682d15c6a6bea1b2f/roles/2b446efbd008435f977d0068496eb403` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:09.144703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b389ef8a914d3fb13173696607c469, user_id=22a95b7a84954f5682d15c6a6bea1b2f, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:09.147601 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:09.171421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 771/1566] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:09 2022] PUT /identity/v3/projects/a0b389ef8a914d3fb13173696607c469/users/22a95b7a84954f5682d15c6a6bea1b2f/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:09.552753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:09.553071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:09.553348 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:09.598548 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:09.599802 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:09.695489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:09.716306 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 796/1567] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:09.721769 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:09.815910 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6602884-af46-4dbf-a209-afee6c225d30 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:09.832580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:09.834772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:09.834772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:09.834772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] PATH_INFO: `/v3/projects` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:09.835525 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:09.838232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:09.889578 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 772/1568] 10.222.0.18 () {60 vars in 1153 bytes} [Tue Jul 26 10:25:09 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:09.890798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:09.904342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9f75-0eaf-4b69-a149-bc0cd27829d4 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:10.021315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:10.022595 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:10.026636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:10.026636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:10.026791 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:10.029445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:10.070320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 797/1569] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Jul 26 10:25:09 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 10:25:10.077221 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:10.089767 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3c843-ff63-42d3-a12a-52439ae0596f admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:10.098209 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:10.101737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:10.102261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:10.102650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:10.103678 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:10.106118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:10.136359 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 773/1570] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 10:25:10.140261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:10.166798 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3b9f7-3bed-47bb-a58b-56cf487ec7c3 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:10.193433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:10.202324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:10.204793 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:10.205091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] PATH_INFO: `/v3/projects/a7d6829ddc9c42e6ac96d87198166984/users/c92de0d53cd84fe490810d79396955b7/roles/2b446efbd008435f977d0068496eb403` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:10.254334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d6829ddc9c42e6ac96d87198166984, user_id=c92de0d53cd84fe490810d79396955b7, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:10.257822 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:10.288097 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 798/1571] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:10 2022] PUT /identity/v3/projects/a7d6829ddc9c42e6ac96d87198166984/users/c92de0d53cd84fe490810d79396955b7/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:10.289187 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:10.313451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2067b-1a2d-4e6e-b7c9-bb8a7b1fc192 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:10.446703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f61c26-9b17-4125-a114-89c0e0bbeeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:10.449405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61c26-9b17-4125-a114-89c0e0bbeeef admin admin] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:10.449872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61c26-9b17-4125-a114-89c0e0bbeeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:10.451941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f61c26-9b17-4125-a114-89c0e0bbeeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:10.453392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61c26-9b17-4125-a114-89c0e0bbeeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:10.455259 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f61c26-9b17-4125-a114-89c0e0bbeeef admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:10.469969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 774/1572] 10.222.0.18 () {58 vars in 1122 bytes} [Tue Jul 26 10:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 10:25:10.474222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:10.490960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdff533-c0f1-4698-9b85-fe0791ba88d1 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:10.497612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:10.498895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:10.499228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:10.499649 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] PATH_INFO: `/v3/projects/a7d6829ddc9c42e6ac96d87198166984/users/c92de0d53cd84fe490810d79396955b7/roles/2b446efbd008435f977d0068496eb403` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:10.501906 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d6829ddc9c42e6ac96d87198166984, user_id=c92de0d53cd84fe490810d79396955b7, role_id=2b446efbd008435f977d0068496eb403)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:10.508416 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:10.561389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 799/1573] 10.222.0.18 () {60 vars in 1483 bytes} [Tue Jul 26 10:25:10 2022] PUT /identity/v3/projects/a7d6829ddc9c42e6ac96d87198166984/users/c92de0d53cd84fe490810d79396955b7/roles/2b446efbd008435f977d0068496eb403 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:25:15.550246 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727e0d-17d5-4f79-a979-d80149274cf7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:15.550762 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727e0d-17d5-4f79-a979-d80149274cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:15.550831 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727e0d-17d5-4f79-a979-d80149274cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:15.610152 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7a727e0d-17d5-4f79-a979-d80149274cf7 None None] MFA Rules not processed for user `22a95b7a84954f5682d15c6a6bea1b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:15.611477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7a727e0d-17d5-4f79-a979-d80149274cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:15.695494 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:15.767763 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 775/1574] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:15.802112 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:15.804597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:15.954486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386d82-4b7a-424c-bccf-f6d6123ce986 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:15.959868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82bfade65449437b928932715d5e8a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:15.960530 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:15.960807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:15.961125 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:16.031094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:16.066233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:16.068368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:16.081570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 800/1575] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:16.439272 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc4da-932a-4494-855f-c698efa80fc1 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:16.439573 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc4da-932a-4494-855f-c698efa80fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:16.439854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdc4da-932a-4494-855f-c698efa80fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:16.519800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-32fdc4da-932a-4494-855f-c698efa80fc1 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:16.521109 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-32fdc4da-932a-4494-855f-c698efa80fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:16.680360 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 776/1576] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:16.912232 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:16.916410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:17.105819 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29935f7-ef2e-47ce-bd19-a43e61b6b4c2 service glance] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:17.113969 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:17.114487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:17.114775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:17.115029 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:17.143280 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:17.145113 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:17.169626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 801/1577] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:25:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:25:17.613503 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1748-810c-45fa-adef-700fbfbdc896 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:17.614104 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1748-810c-45fa-adef-700fbfbdc896 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:17.614585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb1748-810c-45fa-adef-700fbfbdc896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:17.654550 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-68fb1748-810c-45fa-adef-700fbfbdc896 None None] MFA Rules not processed for user `c92de0d53cd84fe490810d79396955b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:17.657932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-68fb1748-810c-45fa-adef-700fbfbdc896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:17.877402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 777/1578] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:17.915431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:17.952694 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbe880-7047-4d18-8cbd-4d33c856c48b service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:17.963431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82bfade65449437b928932715d5e8a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:17.964668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:17.965368 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:17.966091 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:18.100575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:18.102432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:18.130044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 802/1579] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:20.327154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e151-9eb6-40c7-84c4-45a86df19ed3 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.327742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e151-9eb6-40c7-84c4-45a86df19ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.327742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493e151-9eb6-40c7-84c4-45a86df19ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.369784 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-f493e151-9eb6-40c7-84c4-45a86df19ed3 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:20.371505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-f493e151-9eb6-40c7-84c4-45a86df19ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:20.385627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 778/1580] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:20.409889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:20.426408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400d545-215d-478c-bf25-58b34225d52f service glance] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:20.443337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40dc84-5145-47ca-96bc-9361168b1e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:20.443950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40dc84-5145-47ca-96bc-9361168b1e2b service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:20.445009 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40dc84-5145-47ca-96bc-9361168b1e2b service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:20.445581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40dc84-5145-47ca-96bc-9361168b1e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:20.456476 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40dc84-5145-47ca-96bc-9361168b1e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:20.458231 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40dc84-5145-47ca-96bc-9361168b1e2b service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:20.478691 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 803/1581] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:25:29.242343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971bea-98a6-4e63-a5a0-782017f1269f None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:29.242870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971bea-98a6-4e63-a5a0-782017f1269f None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:29.242870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e971bea-98a6-4e63-a5a0-782017f1269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:29.263229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7e971bea-98a6-4e63-a5a0-782017f1269f None None] MFA Rules not processed for user `2729788a5dfe4bf983410566d3026412`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:29.264985 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7e971bea-98a6-4e63-a5a0-782017f1269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:29.273803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 779/1582] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:29.585852 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f2cdb-bdf6-4671-9fa8-edd9a1a40123 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:29.586600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f2cdb-bdf6-4671-9fa8-edd9a1a40123 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:29.586600 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f2cdb-bdf6-4671-9fa8-edd9a1a40123 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:29.588018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 804/1583] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 10:25:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:25:29.594395 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8dbd-55ac-4df1-92f5-c2d6c3c62ded None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:29.594943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8dbd-55ac-4df1-92f5-c2d6c3c62ded None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:29.595292 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc8dbd-55ac-4df1-92f5-c2d6c3c62ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:29.615814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:29.633878 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-97bc8dbd-55ac-4df1-92f5-c2d6c3c62ded None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:29.635083 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-97bc8dbd-55ac-4df1-92f5-c2d6c3c62ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:29.702905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 780/1584] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:29.708163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741305-8d30-4d9b-a6ea-350f9586e0d2 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:29.708444 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741305-8d30-4d9b-a6ea-350f9586e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:29.708719 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a741305-8d30-4d9b-a6ea-350f9586e0d2 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:29.710391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 805/1585] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 26 10:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:29.715382 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ba56-cf6f-49c8-ab71-cf7d76ac3823 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:29.715667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ba56-cf6f-49c8-ab71-cf7d76ac3823 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:29.715941 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42ba56-cf6f-49c8-ab71-cf7d76ac3823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:29.737540 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-dc42ba56-cf6f-49c8-ab71-cf7d76ac3823 None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:29.738865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-dc42ba56-cf6f-49c8-ab71-cf7d76ac3823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:29.749465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 781/1586] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:29.761658 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741305-8d30-4d9b-a6ea-350f9586e0d2 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:29.763987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-4a741305-8d30-4d9b-a6ea-350f9586e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:29.778499 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a741305-8d30-4d9b-a6ea-350f9586e0d2 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:29.782732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81f705-b65f-48b3-b30b-31499dd794e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82bfade65449437b928932715d5e8a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:29.783364 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f705-b65f-48b3-b30b-31499dd794e9 service glance] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:29.783672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f705-b65f-48b3-b30b-31499dd794e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:29.783958 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81f705-b65f-48b3-b30b-31499dd794e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:29.794677 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81f705-b65f-48b3-b30b-31499dd794e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:29.796644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81f705-b65f-48b3-b30b-31499dd794e9 service glance] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:29.807553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 806/1587] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:30.165836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be276d7-cc5f-4fc5-a0f2-197e5e52e183 None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.166157 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be276d7-cc5f-4fc5-a0f2-197e5e52e183 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.166425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be276d7-cc5f-4fc5-a0f2-197e5e52e183 None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.168007 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 782/1588] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 26 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:30.175631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698f6bb-5480-47d0-9336-7c92fc669e29 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.175959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698f6bb-5480-47d0-9336-7c92fc669e29 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.176045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698f6bb-5480-47d0-9336-7c92fc669e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.220263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:30.224792 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-d698f6bb-5480-47d0-9336-7c92fc669e29 None None] MFA Rules not processed for user `99a24c94f072452f8924a76f97ff2683`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:30.226541 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-d698f6bb-5480-47d0-9336-7c92fc669e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:30.286964 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 807/1589] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:30.298707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be276d7-cc5f-4fc5-a0f2-197e5e52e183 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:30.311055 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be276d7-cc5f-4fc5-a0f2-197e5e52e183 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:30.314725 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090f291-4de3-4605-9435-71869a052dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:30.315317 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f291-4de3-4605-9435-71869a052dff service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.315597 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f291-4de3-4605-9435-71869a052dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.315870 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090f291-4de3-4605-9435-71869a052dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.323131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090f291-4de3-4605-9435-71869a052dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:30.324563 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090f291-4de3-4605-9435-71869a052dff service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:30.332984 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 783/1590] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:30.775025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa6b2-1c46-41fd-a883-06bf8017a24e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.775709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa6b2-1c46-41fd-a883-06bf8017a24e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.777208 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa6b2-1c46-41fd-a883-06bf8017a24e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.778244 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 808/1591] 10.222.0.18 () {54 vars in 962 bytes} [Tue Jul 26 10:25:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:25:30.787594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117cfd4-409d-48bf-bdbd-c2c506a95427 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.789336 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117cfd4-409d-48bf-bdbd-c2c506a95427 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.789634 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117cfd4-409d-48bf-bdbd-c2c506a95427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.800546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094139-0b8c-405a-954c-a6a7e5936b1e None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.800828 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094139-0b8c-405a-954c-a6a7e5936b1e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.801132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094139-0b8c-405a-954c-a6a7e5936b1e None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.802489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 809/1592] 10.222.0.18 () {54 vars in 961 bytes} [Tue Jul 26 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:30.809379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.809789 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.810054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.814839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-5117cfd4-409d-48bf-bdbd-c2c506a95427 None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:30.816163 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-5117cfd4-409d-48bf-bdbd-c2c506a95427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:30.825768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 784/1593] 10.222.0.18 () {58 vars in 1059 bytes} [Tue Jul 26 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:30.839018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:30.840900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:30.844072 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f766-334c-401b-880c-dc603e6de94c None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.844427 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f766-334c-401b-880c-dc603e6de94c None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.844771 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f766-334c-401b-880c-dc603e6de94c None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.846598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 785/1594] 10.222.0.18 () {54 vars in 912 bytes} [Tue Jul 26 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 10:25:30.854978 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.855552 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.856271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.885228 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:30.886668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:30.896566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 786/1595] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:30.909230 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:30.918429 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea5827-cdb4-4501-ab63-c4f6242b3ec2 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:30.922794 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b84f2-f4b8-401c-9c15-4fa614786fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:30.923415 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b84f2-f4b8-401c-9c15-4fa614786fde service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.923693 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b84f2-f4b8-401c-9c15-4fa614786fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.923979 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b84f2-f4b8-401c-9c15-4fa614786fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.942944 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b84f2-f4b8-401c-9c15-4fa614786fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:30.944501 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b84f2-f4b8-401c-9c15-4fa614786fde service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:30.951737 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 810/1596] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Jul 26 10:25:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:30.960644 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:30.962234 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 787/1597] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:30.970796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d752d-6a3c-49fe-8d68-6b63415ee28e None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:30.975987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:30.976856 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:30.977141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:30.977410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:30.979180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:30.992207 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:30.993834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:31.005116 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 811/1598] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:25:32.822885 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c046a0-4296-4afc-ad4b-4d8dbd3a46a2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:32.823465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c046a0-4296-4afc-ad4b-4d8dbd3a46a2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:32.823465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c046a0-4296-4afc-ad4b-4d8dbd3a46a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:32.844564 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-06c046a0-4296-4afc-ad4b-4d8dbd3a46a2 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:32.845833 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-06c046a0-4296-4afc-ad4b-4d8dbd3a46a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:32.853497 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 788/1599] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:32.869150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:32.882385 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6f814-213e-4999-bd42-555a754d7d1b service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:32.893896 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:32.895111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:32.895664 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:32.896310 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:32.917076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:32.920629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:32.936923 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 812/1600] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:25:42.839175 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=56 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:42.930391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=61 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:25:48.539836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72cc5-66f1-49e2-b263-cdc2ce594d65 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:48.540470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72cc5-66f1-49e2-b263-cdc2ce594d65 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:48.540470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca72cc5-66f1-49e2-b263-cdc2ce594d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:48.559732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-3ca72cc5-66f1-49e2-b263-cdc2ce594d65 None None] MFA Rules not processed for user `99a24c94f072452f8924a76f97ff2683`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:48.561252 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3ca72cc5-66f1-49e2-b263-cdc2ce594d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:48.568271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 789/1601] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Jul 26 10:25:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:48.582895 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:48.594836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9fa9-68da-4a6d-bc3a-7b20e5c74988 service swift] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:48.599377 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb73a3-95cb-485c-82fb-b02f823c80fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:48.600130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb73a3-95cb-485c-82fb-b02f823c80fb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:48.600424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb73a3-95cb-485c-82fb-b02f823c80fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:48.600707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb73a3-95cb-485c-82fb-b02f823c80fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:48.610012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb73a3-95cb-485c-82fb-b02f823c80fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:48.611747 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb73a3-95cb-485c-82fb-b02f823c80fb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:48.621195 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 813/1602] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:49.538834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29011bd-d34d-4693-9caa-f9528fc1c48d None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:49.543025 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29011bd-d34d-4693-9caa-f9528fc1c48d None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:49.543715 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29011bd-d34d-4693-9caa-f9528fc1c48d None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:49.546883 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 790/1603] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:25:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:49.576299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc396f-70d4-4f64-a146-5a2ef19c3d27 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:49.576299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc396f-70d4-4f64-a146-5a2ef19c3d27 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:49.576299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc396f-70d4-4f64-a146-5a2ef19c3d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:49.607460 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-27bc396f-70d4-4f64-a146-5a2ef19c3d27 None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:49.611335 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-27bc396f-70d4-4f64-a146-5a2ef19c3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:49.623872 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 814/1604] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:25:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:25:49.646432 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29011bd-d34d-4693-9caa-f9528fc1c48d None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:49.662193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29011bd-d34d-4693-9caa-f9528fc1c48d None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:49.669619 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d49d13-dabf-4627-8891-405e0ac27316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:49.670271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49d13-dabf-4627-8891-405e0ac27316 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:49.670553 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49d13-dabf-4627-8891-405e0ac27316 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:49.670825 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d49d13-dabf-4627-8891-405e0ac27316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:49.680758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d49d13-dabf-4627-8891-405e0ac27316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:49.682430 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d49d13-dabf-4627-8891-405e0ac27316 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:49.694477 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 791/1605] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:25:56.690332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a54c90-6007-4cd1-9ba1-36dd9df5d2fb None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:56.690950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a54c90-6007-4cd1-9ba1-36dd9df5d2fb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:56.690950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a54c90-6007-4cd1-9ba1-36dd9df5d2fb None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:56.692282 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 815/1606] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:25:56.701932 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341afb-3581-44a7-a681-0cb58e26c18e None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:56.702517 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341afb-3581-44a7-a681-0cb58e26c18e None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:56.703084 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5341afb-3581-44a7-a681-0cb58e26c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:56.724730 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-a5341afb-3581-44a7-a681-0cb58e26c18e None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:25:56.725905 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a5341afb-3581-44a7-a681-0cb58e26c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:25:56.735628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 792/1607] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:25:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:25:56.751630 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a54c90-6007-4cd1-9ba1-36dd9df5d2fb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:25:56.767961 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a54c90-6007-4cd1-9ba1-36dd9df5d2fb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:25:56.774013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:25:56.774646 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:25:56.775078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:25:56.775185 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:25:56.786778 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:25:56.788506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:25:56.800886 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 816/1608] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:26:06.718768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=12 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:06.795324 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=15 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:16.491142 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d7d4-9449-4436-b252-4396b011fbd2 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:16.491631 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d7d4-9449-4436-b252-4396b011fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:16.491718 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996d7d4-9449-4436-b252-4396b011fbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:16.510211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-7996d7d4-9449-4436-b252-4396b011fbd2 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:26:16.511411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7996d7d4-9449-4436-b252-4396b011fbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:26:16.518433 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 793/1609] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:26:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:26:24.055880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:26:24.066000 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76410b4-15a8-4de7-aafe-41fdd231820d service nova] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:26:24.069826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7d7d2-7d1d-418f-8f9c-1945578e26ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:26:24.070448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d7d2-7d1d-418f-8f9c-1945578e26ab service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:24.070724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d7d2-7d1d-418f-8f9c-1945578e26ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:24.070995 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7d7d2-7d1d-418f-8f9c-1945578e26ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:24.082727 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d7d2-7d1d-418f-8f9c-1945578e26ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:26:24.084332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7d7d2-7d1d-418f-8f9c-1945578e26ab service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:26:24.094893 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 817/1610] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:26:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:26:26.267018 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff12a41-ed3f-4255-9358-b3b8d0075d1a None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:26.268407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff12a41-ed3f-4255-9358-b3b8d0075d1a None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:26.268407 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff12a41-ed3f-4255-9358-b3b8d0075d1a None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:26.276320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 794/1611] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:26:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:26:26.284580 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd319d-3527-45f3-9bf0-32be833aa7b1 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:26.285073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd319d-3527-45f3-9bf0-32be833aa7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:26.285701 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd319d-3527-45f3-9bf0-32be833aa7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:26.310981 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5fdd319d-3527-45f3-9bf0-32be833aa7b1 None None] MFA Rules not processed for user `038cbaf398214c2cbca2383eb8fa7fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:26:26.312235 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5fdd319d-3527-45f3-9bf0-32be833aa7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:26:26.322889 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 818/1612] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:26:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 10:26:26.336532 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff12a41-ed3f-4255-9358-b3b8d0075d1a None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:26:26.352511 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff12a41-ed3f-4255-9358-b3b8d0075d1a None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:26:26.359008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a471a-fb73-4b94-9863-fa03b4cb2f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:26:26.359988 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a471a-fb73-4b94-9863-fa03b4cb2f16 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:26:26.360472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a471a-fb73-4b94-9863-fa03b4cb2f16 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:26:26.361796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a471a-fb73-4b94-9863-fa03b4cb2f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:26:26.380462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a471a-fb73-4b94-9863-fa03b4cb2f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:26:26.384179 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a471a-fb73-4b94-9863-fa03b4cb2f16 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:26:26.398001 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 795/1613] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:26:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:26:36.304779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=9 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:26:36.391907 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=9 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:27:14.369781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:14.370342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:14.370342 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:14.388829 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:27:14.390074 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:27:14.398370 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 819/1614] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:27:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:27:24.383623 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:27:30.127266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a29e-99a0-4531-b355-4ca7a24831b7 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:30.127766 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a29e-99a0-4531-b355-4ca7a24831b7 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:30.127861 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65a29e-99a0-4531-b355-4ca7a24831b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:30.148039 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-8d65a29e-99a0-4531-b355-4ca7a24831b7 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:27:30.149376 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-8d65a29e-99a0-4531-b355-4ca7a24831b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:27:30.156263 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 796/1615] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:27:30.197617 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:27:30.209312 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d02f0-0584-46c5-9323-bc12d83dff12 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:27:30.214489 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01269d3a-f232-4037-897a-79f91c095737 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:27:30.215101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269d3a-f232-4037-897a-79f91c095737 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:30.215378 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269d3a-f232-4037-897a-79f91c095737 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:30.215650 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01269d3a-f232-4037-897a-79f91c095737 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:30.223731 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01269d3a-f232-4037-897a-79f91c095737 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:27:30.225355 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01269d3a-f232-4037-897a-79f91c095737 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:27:30.233334 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 820/1616] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:27:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:27:35.608264 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:35.608757 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:35.608898 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:35.627445 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:27:35.628624 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:27:35.636028 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 797/1617] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:27:35.935629 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4cc70-748e-4b42-9557-306d636c1838 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:35.936105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4cc70-748e-4b42-9557-306d636c1838 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:35.936201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4cc70-748e-4b42-9557-306d636c1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:35.956044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-bfc4cc70-748e-4b42-9557-306d636c1838 None None] MFA Rules not processed for user `99a24c94f072452f8924a76f97ff2683`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:27:35.957361 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-bfc4cc70-748e-4b42-9557-306d636c1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:27:35.964373 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 821/1618] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:27:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:27:35.975655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:27:35.985151 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ad802-93bb-432e-9907-e76314ef8747 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:27:35.988929 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:27:35.989538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:27:35.989811 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:27:35.990081 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:27:35.997451 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:27:35.998873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:27:36.006505 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 798/1619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:27:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:27:45.951226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=9 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:27:46.003225 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=12 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:07.093684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e95ff-5c15-4f07-b928-9b6355a15e82 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:07.094253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e95ff-5c15-4f07-b928-9b6355a15e82 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:07.094337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e95ff-5c15-4f07-b928-9b6355a15e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:07.114926 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-5e6e95ff-5c15-4f07-b928-9b6355a15e82 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:28:07.116276 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-5e6e95ff-5c15-4f07-b928-9b6355a15e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:28:07.124067 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 822/1620] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 26 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:28:07.137594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:28:07.151450 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343fc12-a6f8-406b-8721-1047bd697191 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:28:07.157322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:28:07.157959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:07.158238 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:07.158510 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:07.167959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:28:07.169592 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:28:07.178271 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 799/1621] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:28:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:28:17.109016 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:17.174752 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:31.311322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:31.312200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:31.312480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:31.332554 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:28:31.333827 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:28:31.340599 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 823/1622] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:28:32.530485 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:28:32.542237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9e960-ccfe-4e61-a550-bbc045529976 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:28:32.547213 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:28:32.547817 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:32.548095 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:32.548365 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:32.557268 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:28:32.558836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:28:32.568309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 800/1623] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:28:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:28:41.326077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:42.564330 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:28:50.028290 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:28:50.038077 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ae372-877e-42d2-a2aa-7d9626eec0b7 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:28:50.042222 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:28:50.042847 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:28:50.043134 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:28:50.043412 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:28:50.052403 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:28:50.053922 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:28:50.066148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 824/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:28:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:29:00.059837 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:30:46.283020 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:46.295667 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634d22-e1bb-4e5a-875b-9c4e915eb1b2 service placement] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:46.301689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:46.302299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:46.302574 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:46.302844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:46.310655 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:46.312218 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:46.321556 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 801/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:46.368481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:46.377570 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1f2d0-635f-4c2f-b43d-7c81d2cc214f service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:46.381188 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:46.381796 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:46.382078 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:46.382356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:46.392196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:46.393641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:46.404118 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 825/1626] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:48.159384 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:48.220114 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e623a-85ac-4e31-89d6-0e6161cc81ef service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:48.224026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c3969e48a534d8babef2991941c01bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:48.224663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:48.224971 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:48.225237 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:48.237402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:48.238843 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:48.250735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 802/1627] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:48.270390 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:48.279449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae315e8-9575-41cb-857c-9877f878b3b0 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:48.284916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f66024-897d-40ff-bffa-e6797767e4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:48.285575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f66024-897d-40ff-bffa-e6797767e4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:48.285826 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f66024-897d-40ff-bffa-e6797767e4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:48.286101 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f66024-897d-40ff-bffa-e6797767e4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:48.294381 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f66024-897d-40ff-bffa-e6797767e4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:48.297526 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f66024-897d-40ff-bffa-e6797767e4cb service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:48.307470 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 826/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:53.649408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:53.661706 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b25520-1b94-4bf3-9a46-956ac5fa5a31 service cinder] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:53.669498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:53.670180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:53.670463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:53.670736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:53.681545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:53.683046 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:53.694768 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 803/1629] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:30:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:30:54.786764 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868d88-9732-4466-aeee-db67a8b8ddab None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:54.787270 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868d88-9732-4466-aeee-db67a8b8ddab None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:54.787366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868d88-9732-4466-aeee-db67a8b8ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:54.806462 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-56868d88-9732-4466-aeee-db67a8b8ddab None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:30:54.807704 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-56868d88-9732-4466-aeee-db67a8b8ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:30:54.815502 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 827/1630] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 26 10:30:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:30:54.861337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:54.872531 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4ebc6-3a16-4a44-a24f-bfdaa708d623 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:54.877990 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a466-df05-479c-97c9-139582361058 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:54.878594 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a466-df05-479c-97c9-139582361058 service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:54.878871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a466-df05-479c-97c9-139582361058 service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:54.879144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444a466-df05-479c-97c9-139582361058 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:54.887663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444a466-df05-479c-97c9-139582361058 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:54.889278 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444a466-df05-479c-97c9-139582361058 service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:54.899332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 804/1631] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:30:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:30:55.377455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b1ab-ba19-41d0-8a3d-2eea92ebfc86 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:55.377745 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b1ab-ba19-41d0-8a3d-2eea92ebfc86 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:55.378022 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636b1ab-ba19-41d0-8a3d-2eea92ebfc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:55.396538 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-0636b1ab-ba19-41d0-8a3d-2eea92ebfc86 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:30:55.397772 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0636b1ab-ba19-41d0-8a3d-2eea92ebfc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:30:55.404959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 828/1632] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:30:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:30:55.416736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a466-df05-479c-97c9-139582361058 service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:30:55.428937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444a466-df05-479c-97c9-139582361058 service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:30:55.433972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:30:55.434584 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:30:55.434865 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:30:55.435166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:30:55.443849 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:30:55.445452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:30:55.453411 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 805/1633] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:30:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:31:03.689345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:03.689986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:03.689986 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:03.708940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] MFA Rules not processed for user `2729788a5dfe4bf983410566d3026412`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:31:03.710131 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:31:03.717281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 829/1634] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:31:03.962419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:03.971740 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11314cbc-8568-4a2c-91a6-2d96db2f651a service swift] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:03.975448 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ba1b0-9e06-4fd4-a610-375ba010802b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:03.976059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ba1b0-9e06-4fd4-a610-375ba010802b service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:03.976343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ba1b0-9e06-4fd4-a610-375ba010802b service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:03.978960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ba1b0-9e06-4fd4-a610-375ba010802b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:03.984486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ba1b0-9e06-4fd4-a610-375ba010802b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:03.985967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ba1b0-9e06-4fd4-a610-375ba010802b service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:03.995482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 806/1635] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:04.307723 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:04.320463 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c90af-b975-4340-b92b-89619558dafb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:04.326775 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:04.327902 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:04.328226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:04.328672 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:04.339443 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:04.341132 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:04.351571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 830/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:05.595299 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:05.595812 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:05.595913 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:05.620180 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:31:05.621421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:31:05.629912 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 807/1637] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Jul 26 10:31:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:31:05.643565 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:05.663479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929bed8-d70e-4ba5-b92a-2b8bb1f19072 service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:05.672058 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d177a7ce-c88e-497e-a330-7dba71b63cc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:05.672713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177a7ce-c88e-497e-a330-7dba71b63cc6 service swift] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:05.673008 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177a7ce-c88e-497e-a330-7dba71b63cc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:05.674089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d177a7ce-c88e-497e-a330-7dba71b63cc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:05.684909 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177a7ce-c88e-497e-a330-7dba71b63cc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:05.686576 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d177a7ce-c88e-497e-a330-7dba71b63cc6 service swift] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:05.695965 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 831/1638] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:31:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:31:05.874743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:05.909369 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7660ea-027d-4aa9-80a4-5942c33dfd10 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:05.929632 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:05.931702 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:05.932824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:05.933288 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:05.969685 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:05.973669 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:05.991233 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 808/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:31:15.692455 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=33 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:15.983607 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=65 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:22.038572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:22.039057 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:22.039150 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:22.058387 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:31:22.059589 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:31:22.067096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 832/1640] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:31:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:31:24.424743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:24.442435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b1e7c-1b27-4c8a-a238-6d02a9ffb2a5 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:24.450663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:24.452193 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:24.452439 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:24.453036 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:24.466363 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:24.468418 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:24.485997 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 809/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:32.053606 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=3 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:34.476996 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:36.975977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:36.987380 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedb391-6a0d-4ce3-9352-28f5ab74f6f8 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:36.991546 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14dc5a-d50a-4d69-9b0b-13b1d295e467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:36.992281 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14dc5a-d50a-4d69-9b0b-13b1d295e467 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:36.993035 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14dc5a-d50a-4d69-9b0b-13b1d295e467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:36.993148 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14dc5a-d50a-4d69-9b0b-13b1d295e467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:37.003435 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14dc5a-d50a-4d69-9b0b-13b1d295e467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:37.005049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14dc5a-d50a-4d69-9b0b-13b1d295e467 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:37.015738 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 833/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:38.730733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:31:38.763329 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06efcd-4dc3-48d8-bb0e-76e1417200e2 service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:31:38.773967 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:31:38.775289 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:31:38.775675 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:31:38.776102 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:31:38.788013 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:31:38.790468 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:31:38.806696 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 810/1643] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:31:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:31:47.011130 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=6 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:31:48.801141 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=6 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:33:44.930799 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:33:44.931349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:33:44.931349 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:33:44.958868 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] MFA Rules not processed for user `db37665594e64bef995ef708f0e84546`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:33:44.960604 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:33:44.986425 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 834/1644] 10.222.0.18 () {58 vars in 958 bytes} [Tue Jul 26 10:33:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:33:45.303358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:33:45.305011 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:33:45.359960 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df8ad-7729-4cea-be3a-cc682d92a21c service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:33:45.363860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:33:45.364480 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:33:45.364758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:33:45.365059 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:33:45.372111 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:33:45.373581 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:33:45.381315 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 811/1645] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:33:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:33:46.276089 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:33:46.305172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79fc4b-76d9-4ad6-bec3-c41e852f3e45 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:33:46.310298 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:33:46.310919 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:33:46.311205 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:33:46.311479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:33:46.313449 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:33:46.337816 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:33:46.339409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacd049-12c2-4b76-924c-00b4daf11af3 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:33:46.350106 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 835/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:33:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:33:55.378062 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=24 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:33:56.345108 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=33 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:04.930045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:04.931662 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:04.942810 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035ed6-adc1-457a-adfc-e82d387d6df8 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:04.946703 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:04.947332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:04.947612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:04.947891 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:04.958465 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:04.959920 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:04.969972 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 812/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:34:06.532991 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:06.533473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:06.533748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:06.564383 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] MFA Rules not processed for user `014510743ad14e7f9bd781a04d7890e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:34:06.565641 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:06.582396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 836/1648] 10.222.0.18 () {58 vars in 967 bytes} [Tue Jul 26 10:34:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:34:06.628795 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:06.642845 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b68d1e-6a03-49f8-8ed0-a21fa307818f service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:06.648469 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f891780-cfdb-4d07-881d-6aa3d08d731d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7005963bb5b241c2b24a3fe6eab876dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:06.649135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f891780-cfdb-4d07-881d-6aa3d08d731d service swift] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:06.649417 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f891780-cfdb-4d07-881d-6aa3d08d731d service swift] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:06.649684 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f891780-cfdb-4d07-881d-6aa3d08d731d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:06.658567 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f891780-cfdb-4d07-881d-6aa3d08d731d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:06.660172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f891780-cfdb-4d07-881d-6aa3d08d731d service swift] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:06.687155 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 813/1649] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Jul 26 10:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 10:34:07.091839 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:07.103172 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ed9e3-4e23-4094-864c-4c6ae0ca0edb None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:07.107466 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86b68-e2ec-42c2-b99f-0a5abeae4fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:07.108099 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86b68-e2ec-42c2-b99f-0a5abeae4fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:07.108452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86b68-e2ec-42c2-b99f-0a5abeae4fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:07.108940 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86b68-e2ec-42c2-b99f-0a5abeae4fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:07.189249 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86b68-e2ec-42c2-b99f-0a5abeae4fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:07.190807 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f86b68-e2ec-42c2-b99f-0a5abeae4fa2 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:07.211461 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 837/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:34:10.681803 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d65b-d45b-4ddc-99d9-ee903672e3fe None None] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:10.682319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d65b-d45b-4ddc-99d9-ee903672e3fe None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:10.682408 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d65b-d45b-4ddc-99d9-ee903672e3fe None None] PATH_INFO: `/` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:10.683712 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 814/1651] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:34:10.709421 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece13f25-8be2-45dd-9d2c-d4d575759edb None None] REQUEST_METHOD: `POST` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:10.710824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece13f25-8be2-45dd-9d2c-d4d575759edb None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:10.711337 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece13f25-8be2-45dd-9d2c-d4d575759edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:10.772296 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.auth.core [None req-ece13f25-8be2-45dd-9d2c-d4d575759edb None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:34:10.774735 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ece13f25-8be2-45dd-9d2c-d4d575759edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:10.786044 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 838/1652] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:34:10.798533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7d65b-d45b-4ddc-99d9-ee903672e3fe None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:10.813353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7d65b-d45b-4ddc-99d9-ee903672e3fe None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:10.819143 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da14c3-922b-42e9-9c02-5091b61d782c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:10.819814 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da14c3-922b-42e9-9c02-5091b61d782c service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:10.820094 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da14c3-922b-42e9-9c02-5091b61d782c service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:10.820366 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da14c3-922b-42e9-9c02-5091b61d782c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:10.829353 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da14c3-922b-42e9-9c02-5091b61d782c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:10.830977 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da14c3-922b-42e9-9c02-5091b61d782c service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:10.840937 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 815/1653] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:34:13.833558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514862-7c55-4faa-bfd9-ce753fc30ad9 None None] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:13.834402 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514862-7c55-4faa-bfd9-ce753fc30ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:13.835236 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e514862-7c55-4faa-bfd9-ce753fc30ad9 None None] PATH_INFO: `/` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:13.837709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 839/1654] 10.222.0.18 () {54 vars in 921 bytes} [Tue Jul 26 10:34:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 10:34:13.873836 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] REQUEST_METHOD: `POST` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:13.874391 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:13.874709 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:13.894759 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.auth.core [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] MFA Rules not processed for user `cb74cb8c3eb34807b834367ccf09278b`. Rule list: `[]` (Enabled: `True`). {{(pid=80311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 10:34:13.896107 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:13.908371 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 816/1655] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Jul 26 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 10:34:13.922026 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e514862-7c55-4faa-bfd9-ce753fc30ad9 None None] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:13.935409 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:13.948379 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e514862-7c55-4faa-bfd9-ce753fc30ad9 None None] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:13.948760 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ffcce-c981-4d84-8be0-85b7b4424e81 None None] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:13.953393 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:13.954038 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:13.954168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:13.954322 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:13.954656 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:13.954779 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] PATH_INFO: `/v3/users/2729788a5dfe4bf983410566d3026412` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:13.955673 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:13.956019 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:13.956135 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2729788a5dfe4bf983410566d3026412)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:13.957269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: WARNING py.warnings [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:34:13.957269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: warnings.warn(msg) Jul 26 10:34:13.957269 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: Jul 26 10:34:13.958472 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:13.965875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:13.967481 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:13.979140 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 840/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:34:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:34:14.031176 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2729788a5dfe4bf983410566d3026412'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.038615 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2729788a5dfe4bf983410566d3026412'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.039389 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2729788a5dfe4bf983410566d3026412'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.057612 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2729788a5dfe4bf983410566d3026412'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.058316 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2729788a5dfe4bf983410566d3026412'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.073748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 817/1657] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 10:34:13 2022] DELETE /identity/v3/users/2729788a5dfe4bf983410566d3026412 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 10:34:14.258572 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:14.272087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e8fe-db05-4040-bb77-9c2917609cc8 service placement] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:14.330309 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:14.330875 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:14.331154 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:14.331428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] PATH_INFO: `/v3/projects/63ca665a2ea84af181a71d3fb61b8f56` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:14.332571 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ca665a2ea84af181a71d3fb61b8f56)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:14.333613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: WARNING py.warnings [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 10:34:14.333613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: warnings.warn(msg) Jul 26 10:34:14.333613 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: Jul 26 10:34:14.334808 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:14.352700 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=100 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:14.389585 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ca665a2ea84af181a71d3fb61b8f56', 'request_id': 'req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.396776 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ca665a2ea84af181a71d3fb61b8f56', 'request_id': 'req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.403068 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ca665a2ea84af181a71d3fb61b8f56', 'request_id': 'req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.433181 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] The token cache is being invalidate because project 63ca665a2ea84af181a71d3fb61b8f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:34:14.433555 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.434196 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.435722 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 841/1658] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 10:34:14 2022] DELETE /identity/v3/projects/63ca665a2ea84af181a71d3fb61b8f56 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:14.439874 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:14.442049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:14.458506 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8ef50-a714-4b69-955e-280102745330 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:14.515054 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:14.515695 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:14.515975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:14.516251 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] PATH_INFO: `/v3/users/22a95b7a84954f5682d15c6a6bea1b2f` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:14.517424 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a95b7a84954f5682d15c6a6bea1b2f)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:14.519356 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:14.547916 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:14.566717 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a95b7a84954f5682d15c6a6bea1b2f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.573880 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a95b7a84954f5682d15c6a6bea1b2f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.574498 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a95b7a84954f5682d15c6a6bea1b2f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.586661 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a95b7a84954f5682d15c6a6bea1b2f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.587303 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a95b7a84954f5682d15c6a6bea1b2f'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.599076 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 818/1659] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 10:34:14 2022] DELETE /identity/v3/users/22a95b7a84954f5682d15c6a6bea1b2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:14.772482 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:34:14.773950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:34:14.787345 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9f9c-c513-4fe4-aee7-9f7ee3ecae5b admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:34:14.849733 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:34:14.850392 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:34:14.850713 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:34:14.850931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] PATH_INFO: `/v3/projects/a0b389ef8a914d3fb13173696607c469` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:34:14.853071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b389ef8a914d3fb13173696607c469)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:34:14.854998 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:34:14.908921 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b389ef8a914d3fb13173696607c469', 'request_id': 'req-1b3a734e-dcca-4104-a5e6-6d1225369a9e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.917513 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b389ef8a914d3fb13173696607c469', 'request_id': 'req-1b3a734e-dcca-4104-a5e6-6d1225369a9e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.923406 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b389ef8a914d3fb13173696607c469', 'request_id': 'req-1b3a734e-dcca-4104-a5e6-6d1225369a9e'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.935012 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] The token cache is being invalidate because project a0b389ef8a914d3fb13173696607c469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:34:14.935320 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.936144 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:34:14.944508 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 842/1660] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 10:34:14 2022] DELETE /identity/v3/projects/a0b389ef8a914d3fb13173696607c469 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:34:24.595652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:34:24.931800 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:09.444758 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:09.446265 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:09.502633 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0819e-242f-4560-8d28-309fcc4bf80a admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:09.548566 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:09.549206 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:09.549483 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:09.549753 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:09.551479 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:09.627024 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:09.628558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:09.646524 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 819/1661] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:36:10.565724 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:10.567200 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:10.585227 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a734e-dcca-4104-a5e6-6d1225369a9e admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:10.589210 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:10.590518 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:10.590873 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:10.591242 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:10.593279 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:10.607459 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:10.610343 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:10.623452 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 843/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:36:10.673405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:10.674832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:10.685535 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da42bfc-3d93-4267-934f-946516fc1e31 service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:10.689399 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:10.690034 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:10.690436 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:10.690598 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:10.692625 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:10.736258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=100 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:10.780241 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:10.782041 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:10.804832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 820/1663] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:36:11.990736 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:11.999173 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26337e5-2620-4860-b2a8-eed8cded1276 service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:12.002787 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:12.003397 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:12.003676 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:12.003950 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:12.005708 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:12.019834 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:12.021226 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:12.033441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 844/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:36:12.945627 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:12.947096 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:12.961918 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec945b-2e91-424f-b000-df7ab26e50ad service neutron] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:12.972744 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75142-a395-495a-996c-775b3b7374be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '038cbaf398214c2cbca2383eb8fa7fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:12.973558 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75142-a395-495a-996c-775b3b7374be service nova] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:12.973888 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75142-a395-495a-996c-775b3b7374be service nova] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:12.974287 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded75142-a395-495a-996c-775b3b7374be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:12.976473 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ded75142-a395-495a-996c-775b3b7374be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:12.990832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded75142-a395-495a-996c-775b3b7374be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:12.992426 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded75142-a395-495a-996c-775b3b7374be service nova] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:13.003732 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 821/1665] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:36:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 10:36:22.027707 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=12 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:22.999332 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=30 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:23.138319 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:23.146871 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634059a1-b28e-42da-bbd6-0e82655cc59c service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:23.150640 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99a24c94f072452f8924a76f97ff2683', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:23.151256 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] REQUEST_METHOD: `GET` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:23.151545 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:23.151824 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:23.153636 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:23.218478 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:23.219930 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:23.229486 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 845/1666] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:36:29.668253 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75142-a395-495a-996c-775b3b7374be service nova] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:29.669931 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-ded75142-a395-495a-996c-775b3b7374be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:29.684699 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded75142-a395-495a-996c-775b3b7374be service nova] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:29.689314 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:29.689975 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:29.690258 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:29.690533 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] PATH_INFO: `/v3/users/db37665594e64bef995ef708f0e84546` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:29.691748 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db37665594e64bef995ef708f0e84546)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:29.693742 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:29.741211 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db37665594e64bef995ef708f0e84546'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:29.748943 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db37665594e64bef995ef708f0e84546'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:29.749582 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db37665594e64bef995ef708f0e84546'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:29.761428 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db37665594e64bef995ef708f0e84546'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:29.762087 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db37665594e64bef995ef708f0e84546'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:29.774647 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 822/1667] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 10:36:29 2022] DELETE /identity/v3/users/db37665594e64bef995ef708f0e84546 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:36:29.954989 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:29.965860 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7afdc2-df8b-4ee5-8a19-5f55b5dda36d service neutron] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:30.022311 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:30.022987 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:30.023266 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:30.023536 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] PATH_INFO: `/v3/projects/97a2b5985dcf4ba9b8c28e305c857381` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:30.024935 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a2b5985dcf4ba9b8c28e305c857381)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:30.027562 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:30.075609 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a2b5985dcf4ba9b8c28e305c857381', 'request_id': 'req-f06bf8f1-b206-4831-b2f2-0fa5d474a663'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.083832 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a2b5985dcf4ba9b8c28e305c857381', 'request_id': 'req-f06bf8f1-b206-4831-b2f2-0fa5d474a663'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.090166 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a2b5985dcf4ba9b8c28e305c857381', 'request_id': 'req-f06bf8f1-b206-4831-b2f2-0fa5d474a663'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.101976 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] The token cache is being invalidate because project 97a2b5985dcf4ba9b8c28e305c857381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:36:30.102261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.102900 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.104405 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 846/1668] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 10:36:29 2022] DELETE /identity/v3/projects/97a2b5985dcf4ba9b8c28e305c857381 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:36:30.108419 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:30.109844 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:30.123071 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c262fa3-a0eb-4815-8425-c96e0dcccc30 admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:30.179726 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:30.180374 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:30.180652 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:30.180962 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] PATH_INFO: `/v3/users/c92de0d53cd84fe490810d79396955b7` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:30.193938 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92de0d53cd84fe490810d79396955b7)` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:30.195934 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:30.241586 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92de0d53cd84fe490810d79396955b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.249220 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92de0d53cd84fe490810d79396955b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.249846 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92de0d53cd84fe490810d79396955b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.256854 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:30.263781 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92de0d53cd84fe490810d79396955b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.265049 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.notifications [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92de0d53cd84fe490810d79396955b7'} {{(pid=80311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.278441 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 823/1669] 10.222.0.18 () {58 vars in 1224 bytes} [Tue Jul 26 10:36:30 2022] DELETE /identity/v3/users/c92de0d53cd84fe490810d79396955b7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:36:30.448659 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Authenticating user token {{(pid=80312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:36:30.450668 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.fernet_utils [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:36:30.465302 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06bf8f1-b206-4831-b2f2-0fa5d474a663 admin admin] Validating token access rules against request {{(pid=80312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:36:30.485201 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:30.523682 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f82692456794f98aaedf11a512d650d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd8d0a5798b4c52a018435ee59fbf54', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:36:30.524344 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:36:30.524628 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:36:30.524959 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] PATH_INFO: `/v3/projects/a7d6829ddc9c42e6ac96d87198166984` {{(pid=80312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:36:30.535073 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d6829ddc9c42e6ac96d87198166984)` {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:36:30.537032 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] RBAC: Authorization granted {{(pid=80312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:36:30.582088 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d6829ddc9c42e6ac96d87198166984', 'request_id': 'req-a8323128-00d9-431b-a00d-92d0f241fb31'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.588575 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d6829ddc9c42e6ac96d87198166984', 'request_id': 'req-a8323128-00d9-431b-a00d-92d0f241fb31'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.594045 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d6829ddc9c42e6ac96d87198166984', 'request_id': 'req-a8323128-00d9-431b-a00d-92d0f241fb31'} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.605229 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] The token cache is being invalidate because project a7d6829ddc9c42e6ac96d87198166984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 10:36:30.605512 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.606159 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG keystone.notifications [None req-a8323128-00d9-431b-a00d-92d0f241fb31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 10:36:30.607663 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: [pid: 80312|app: 0|req: 847/1670] 10.222.0.18 () {58 vars in 1233 bytes} [Tue Jul 26 10:36:30 2022] DELETE /identity/v3/projects/a7d6829ddc9c42e6ac96d87198166984 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 10:36:40.274388 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=8,keystone:DELETE=1 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:36:40.602261 dv-osbrick-850937-2-iscsi devstack@keystone.service[80312]: DEBUG dbcounter [-] [80312] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 10:39:38.387105 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Authenticating user token {{(pid=80311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 10:39:38.388487 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:39:38.455626 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5136d-9c4e-4e30-b091-87e9040ccb8e admin admin] Validating token access rules against request {{(pid=80311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 10:39:38.513475 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb74cb8c3eb34807b834367ccf09278b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '10ce6f12e9694f959993f5381deee202', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 10:39:38.514120 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] REQUEST_METHOD: `GET` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 10:39:38.514410 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] SCRIPT_NAME: `/identity` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 10:39:38.514689 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 10:39:38.516431 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.fernet_utils [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 10:39:38.527168 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 10:39:38.528743 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d190e4-709b-4e9d-b949-cc0f07b8aacd service placement] RBAC: Authorization granted {{(pid=80311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 10:39:38.538358 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: [pid: 80311|app: 0|req: 824/1671] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Jul 26 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 10:39:48.534396 dv-osbrick-850937-2-iscsi devstack@keystone.service[80311]: DEBUG dbcounter [-] [80311] Writing DB stats keystone:SELECT=58 {{(pid=80311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}